[jira] [Comment Edited] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-04-01 Thread Aravind (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392123#comment-14392123 ] Aravind edited comment on KAFKA-2078 at 4/2/15 4:30 AM: Hi Jun, T

[jira] [Commented] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-04-01 Thread Aravind (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392123#comment-14392123 ] Aravind commented on KAFKA-2078: Hi Jun, There is no ZK session timeout on the broker. I

[jira] [Updated] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-01 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Huus updated KAFKA-2082: - Description: While running integration tests for Sarama (the go client) we came across a pattern of conne

[jira] [Commented] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-01 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392017#comment-14392017 ] Evan Huus commented on KAFKA-2082: -- I have pushed another branch called {{test-jira-kafka

[jira] [Commented] (KAFKA-1926) Replace kafka.utils.Utils with o.a.k.common.utils.Utils

2015-04-01 Thread Tong Li (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391999#comment-14391999 ] Tong Li commented on KAFKA-1926: [~junrao]Thanks so much for the quick review. All the new

[jira] [Commented] (KAFKA-1926) Replace kafka.utils.Utils with o.a.k.common.utils.Utils

2015-04-01 Thread Tong Li (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391990#comment-14391990 ] Tong Li commented on KAFKA-1926: Updated reviewboard https://reviews.apache.org/r/32740/

[jira] [Updated] (KAFKA-1926) Replace kafka.utils.Utils with o.a.k.common.utils.Utils

2015-04-01 Thread Tong Li (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tong Li updated KAFKA-1926: --- Attachment: KAFKA-1926_2015-04-01_22:16:46.patch > Replace kafka.utils.Utils with o.a.k.common.utils.Utils > -

Re: Review Request 32740: Patch for KAFKA-1926

2015-04-01 Thread Tong Li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32740/ --- (Updated April 2, 2015, 2:16 a.m.) Review request for kafka. Bugs: KAFKA-1926

[jira] [Commented] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-04-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391970#comment-14391970 ] Jun Rao commented on KAFKA-2078: Do you see ZK session timeout on the broker? With large m

Re: Review Request 30809: Patch for KAFKA-1888

2015-04-01 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30809/#review78630 --- Thanks for the patch. A few high level comments. 1. I think we are

[jira] [Commented] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-01 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391877#comment-14391877 ] Evan Huus commented on KAFKA-2082: -- The 3GB is only set if you use VMware fusion, if you

Build failed in Jenkins: Kafka-trunk #438

2015-04-01 Thread Apache Jenkins Server
See Changes: [junrao] kafka-2013; benchmark test for the purgatory; patched by Yasuhiro Matsuda; reviewed by Jun Rao -- [...truncated 2229 lines...] kafka.message.MessageWriterTest > testWithCompress

[jira] [Created] (KAFKA-2086) testRoundRobinPartitionAssignor transient failure

2015-04-01 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-2086: -- Summary: testRoundRobinPartitionAssignor transient failure Key: KAFKA-2086 URL: https://issues.apache.org/jira/browse/KAFKA-2086 Project: Kafka Issue Type: Sub-task

Build failed in Jenkins: KafkaPreCommit #50

2015-04-01 Thread Apache Jenkins Server
See Changes: [junrao] kafka-2013; benchmark test for the purgatory; patched by Yasuhiro Matsuda; reviewed by Jun Rao -- [...truncated 2090 lines...] kafka.admin.DeleteTopicTest > testDeleteNonExist

[jira] [Updated] (KAFKA-2013) benchmark test for the purgatory

2015-04-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2013: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for t

[jira] [Commented] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-01 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391699#comment-14391699 ] Sriharsha Chintalapani commented on KAFKA-2082: --- [~eapache] I am having hard

[jira] [Commented] (KAFKA-2079) Support exhibitor

2015-04-01 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391680#comment-14391680 ] Joe Stein commented on KAFKA-2079: -- I think if we do this (which we should) the work shou

[jira] [Created] (KAFKA-2085) Return delay time in QuotaViolationException

2015-04-01 Thread Aditya Auradkar (JIRA)
Aditya Auradkar created KAFKA-2085: -- Summary: Return delay time in QuotaViolationException Key: KAFKA-2085 URL: https://issues.apache.org/jira/browse/KAFKA-2085 Project: Kafka Issue Type: Su

[jira] [Created] (KAFKA-2084) byte rate metrics per client ID (producer and consumer)

2015-04-01 Thread Aditya Auradkar (JIRA)
Aditya Auradkar created KAFKA-2084: -- Summary: byte rate metrics per client ID (producer and consumer) Key: KAFKA-2084 URL: https://issues.apache.org/jira/browse/KAFKA-2084 Project: Kafka Iss

[jira] [Created] (KAFKA-2083) Quotas for Kafka

2015-04-01 Thread Aditya Auradkar (JIRA)
Aditya Auradkar created KAFKA-2083: -- Summary: Quotas for Kafka Key: KAFKA-2083 URL: https://issues.apache.org/jira/browse/KAFKA-2083 Project: Kafka Issue Type: New Feature Report

RE: [KIP-DISCUSSION] KIP-13 Quotas

2015-04-01 Thread Aditya Auradkar
Hey everyone, I've made changes to the KIP to capture our discussions over the last couple of weeks. https://cwiki.apache.org/confluence/display/KAFKA/KIP-13+-+Quotas I'll start a voting thread after people have had a chance to read/comment. Thanks, Aditya _

[jira] [Commented] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-04-01 Thread Aravind (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391618#comment-14391618 ] Aravind commented on KAFKA-2078: Also getting few of Connection timed out errors my except

[jira] [Commented] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-01 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391607#comment-14391607 ] Evan Huus commented on KAFKA-2082: -- We are using ZK connection drops as a convenient way

[jira] [Commented] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-01 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391517#comment-14391517 ] Sriharsha Chintalapani commented on KAFKA-2082: --- [~eapache] did a quick look

Build failed in Jenkins: KafkaPreCommit #49

2015-04-01 Thread Apache Jenkins Server
See Changes: [junrao] kafka-2039; Update Scala to 2.10.5 and 2.11.6; patched by Ismael Juma; reviewed by Jun Rao -- [...truncated 2111 lines...] java.net.BindException: Address already in use

Re: Review Request 32740: Patch for KAFKA-1926

2015-04-01 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32740/#review78580 --- Thanks for the new patch. A few more comments. clients/src/main/ja

[jira] [Updated] (KAFKA-1989) New purgatory design

2015-04-01 Thread Yasuhiro Matsuda (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yasuhiro Matsuda updated KAFKA-1989: Attachment: KAFKA-1989_2015-04-01_13:49:58.patch > New purgatory design > --

[jira] [Commented] (KAFKA-1989) New purgatory design

2015-04-01 Thread Yasuhiro Matsuda (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391422#comment-14391422 ] Yasuhiro Matsuda commented on KAFKA-1989: - Updated reviewboard https://reviews.apa

Re: Review Request 31568: Patch for KAFKA-1989

2015-04-01 Thread Yasuhiro Matsuda
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31568/ --- (Updated April 1, 2015, 8:50 p.m.) Review request for kafka. Bugs: KAFKA-1989

Re: Review Request 31568: Patch for KAFKA-1989

2015-04-01 Thread Yasuhiro Matsuda
> On April 1, 2015, 6:46 p.m., Jun Rao wrote: > > core/src/main/scala/kafka/server/DelayedOperation.scala, line 126 > > > > > > timeoutTimer is an implementation detail in ExpiredOperationReaper. > > Could we hide it

[jira] [Updated] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-01 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Huus updated KAFKA-2082: - Description: While running integration tests for Sarama (the go client) we came across a pattern of conne

[jira] [Updated] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-01 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Huus updated KAFKA-2082: - Description: While running integration tests for Sarama (the go client) we came across a pattern of conne

[jira] [Updated] (KAFKA-2039) Update Scala to 2.10.5 and 2.11.6

2015-04-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2039: --- Resolution: Fixed Fix Version/s: 0.8.3 Assignee: Ismael Juma Status: Resolved (was:

[jira] [Updated] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-01 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Huus updated KAFKA-2082: - Description: While running integration tests for Sarama (the go client) we came across a pattern of conne

[jira] [Updated] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-01 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Huus updated KAFKA-2082: - Description: While running integration tests for Sarama (the go client) we came across a pattern of conne

[jira] [Created] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-01 Thread Evan Huus (JIRA)
Evan Huus created KAFKA-2082: Summary: Kafka Replication ends up in a bad state Key: KAFKA-2082 URL: https://issues.apache.org/jira/browse/KAFKA-2082 Project: Kafka Issue Type: Bug Comp

[jira] [Created] (KAFKA-2081) testUncleanLeaderElectionEnabledByTopicOverride transient failure

2015-04-01 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-2081: -- Summary: testUncleanLeaderElectionEnabledByTopicOverride transient failure Key: KAFKA-2081 URL: https://issues.apache.org/jira/browse/KAFKA-2081 Project: Kafka Issue Ty

[jira] [Commented] (KAFKA-1929) Convert core kafka module to use the errors in org.apache.kafka.common.errors

2015-04-01 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391298#comment-14391298 ] Jeff Holoman commented on KAFKA-1929: - [~jkreps] Did you have a chance to review this?

[jira] [Commented] (KAFKA-1926) Replace kafka.utils.Utils with o.a.k.common.utils.Utils

2015-04-01 Thread Tong Li (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391295#comment-14391295 ] Tong Li commented on KAFKA-1926: [~junrao], all comments have been addressed in the latest

Review Request 32740: Patch for KAFKA-1926

2015-04-01 Thread Tong Li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32740/ --- Review request for kafka. Bugs: KAFKA-1926 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-1926) Replace kafka.utils.Utils with o.a.k.common.utils.Utils

2015-04-01 Thread Tong Li (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391281#comment-14391281 ] Tong Li commented on KAFKA-1926: Created reviewboard https://reviews.apache.org/r/32740/

[jira] [Updated] (KAFKA-1926) Replace kafka.utils.Utils with o.a.k.common.utils.Utils

2015-04-01 Thread Tong Li (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tong Li updated KAFKA-1926: --- Attachment: KAFKA-1926.patch > Replace kafka.utils.Utils with o.a.k.common.utils.Utils > -

Re: Review Request 31568: Patch for KAFKA-1989

2015-04-01 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31568/#review78444 --- Thanks for the patch! A few comments below. core/src/main/scala/ka

[jira] [Assigned] (KAFKA-2064) Replace ConsumerMetadataRequest and Response with org.apache.kafka.common.requests objects

2015-04-01 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Holoman reassigned KAFKA-2064: --- Assignee: Jeff Holoman > Replace ConsumerMetadataRequest and Response with > org.apache.kaf

Re: Review Request 28769: Patch for KAFKA-1809

2015-04-01 Thread Jun Rao
> On March 29, 2015, 7:33 p.m., Jun Rao wrote: > > core/src/main/scala/kafka/server/KafkaConfig.scala, lines 345-347 > > > > > > It seems that a 3-digit value like 0.8.2 is also valid? > > Gwen Shapira wrote: > y

[jira] [Commented] (KAFKA-1660) Ability to call close() with a timeout on the Java Kafka Producer.

2015-04-01 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390958#comment-14390958 ] Jiangjie Qin commented on KAFKA-1660: - [~jkreps] Ping to see if you could help review

Re: Does system_test work on MacOs?

2015-04-01 Thread Gwen Shapira
Thanks for confirming :) On Wed, Apr 1, 2015 at 8:42 AM, Jun Rao wrote: > Yes, I was able to run the system tests on mac, after enabling ssh. > > Thanks, > > Jun > > On Tue, Mar 31, 2015 at 6:00 PM, Gwen Shapira wrote: > >> Hi, >> >> The first line of the system_test README says: >> This test fr

Re: Does system_test work on MacOs?

2015-04-01 Thread Jun Rao
Yes, I was able to run the system tests on mac, after enabling ssh. Thanks, Jun On Tue, Mar 31, 2015 at 6:00 PM, Gwen Shapira wrote: > Hi, > > The first line of the system_test README says: > This test framework currently doesn't support MacOS due to different > "ps" argument options from Linu

Re: Any idea why acceptor is volatile in SocketServer?

2015-04-01 Thread Jun Rao
Yes. That sounds good. It also fixes the visibility of processors, which seems to have a potential issue now. Thanks, Jun On Tue, Mar 31, 2015 at 11:25 PM, Gwen Shapira wrote: > Thanks! > > Yeah, the shutdown hook will run on a separate thread. > > In that case, I don't need (or want) to keep

Re: kafka system tests

2015-04-01 Thread Harsha
Geoffrey, One thing I want to consider in re-writing the system tests is the ability to run these on other OS not just linux. If we can support both linux and windows that will be great. I am not sure how much of that work will be involved on the

[jira] [Assigned] (KAFKA-2074) Add UpdateMetadata request/response to o.a.k.common.requests and replace its use in core module

2015-04-01 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani reassigned KAFKA-2074: - Assignee: Sriharsha Chintalapani > Add UpdateMetadata request/response to

[jira] [Assigned] (KAFKA-2073) Replace TopicMetadata request/response with o.a.k.requests.metadata

2015-04-01 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani reassigned KAFKA-2073: - Assignee: Sriharsha Chintalapani > Replace TopicMetadata request/response

[jira] [Commented] (KAFKA-2073) Replace TopicMetadata request/response with o.a.k.requests.metadata

2015-04-01 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390801#comment-14390801 ] Sriharsha Chintalapani commented on KAFKA-2073: --- Thanks :) [~gwenshap] > Re

[jira] [Commented] (KAFKA-2073) Replace TopicMetadata request/response with o.a.k.requests.metadata

2015-04-01 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390790#comment-14390790 ] Gwen Shapira commented on KAFKA-2073: - Take as many of these as you want, my friend. I

[jira] [Commented] (KAFKA-2073) Replace TopicMetadata request/response with o.a.k.requests.metadata

2015-04-01 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390783#comment-14390783 ] Sriharsha Chintalapani commented on KAFKA-2073: --- [~gwenshap] are you plannin

[jira] [Commented] (KAFKA-2074) Add UpdateMetadata request/response to o.a.k.common.requests and replace its use in core module

2015-04-01 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390780#comment-14390780 ] Sriharsha Chintalapani commented on KAFKA-2074: --- [~gwenshap] are you plannin

[jira] [Commented] (KAFKA-2039) Update Scala to 2.10.5 and 2.11.6

2015-04-01 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390168#comment-14390168 ] Ismael Juma commented on KAFKA-2039: Is there anything I can do to help move this alon