[jira] [Commented] (KAFKA-1451) Broker stuck due to leader election race

2015-03-04 Thread Aldrin Seychell (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14346728#comment-14346728 ] Aldrin Seychell commented on KAFKA-1451: I just encountered this issue on version

[jira] [Created] (KAFKA-2002) It does not work when kafka_mx4jenable is false

2015-03-04 Thread Yaguo Zhou (JIRA)
Yaguo Zhou created KAFKA-2002: - Summary: It does not work when kafka_mx4jenable is false Key: KAFKA-2002 URL: https://issues.apache.org/jira/browse/KAFKA-2002 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-2002) It does not work when kafka_mx4jenable is false

2015-03-04 Thread Yaguo Zhou (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaguo Zhou updated KAFKA-2002: -- Attachment: kafka_mx4jenable.patch > It does not work when kafka_mx4jenable is false > -

[jira] [Commented] (KAFKA-1908) Split brain

2015-03-04 Thread Alexey Ozeritskiy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347063#comment-14347063 ] Alexey Ozeritskiy commented on KAFKA-1908: -- Hi all, the following is our scenario

[jira] [Commented] (KAFKA-1809) Refactor brokers to allow listening on multiple ports and IPs

2015-03-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347236#comment-14347236 ] Jun Rao commented on KAFKA-1809: Thanks for the patch. Some comments. 1. KafkaConfig: 1.1

Review Request 31735: Fix KAFKA-1863

2015-03-04 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31735/ --- Review request for kafka. Bugs: KAFKA-1863 https://issues.apache.org/jira/b

[jira] [Updated] (KAFKA-1863) Exception categories / hierarchy in clients

2015-03-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1863: - Status: Patch Available (was: Open) > Exception categories / hierarchy in clients > -

[jira] [Commented] (KAFKA-1863) Exception categories / hierarchy in clients

2015-03-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347338#comment-14347338 ] Guozhang Wang commented on KAFKA-1863: -- Created reviewboard https://reviews.apache.or

[jira] [Updated] (KAFKA-1863) Exception categories / hierarchy in clients

2015-03-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1863: - Attachment: KAFKA-1863.patch > Exception categories / hierarchy in clients > -

[jira] [Commented] (KAFKA-1863) Exception categories / hierarchy in clients

2015-03-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347342#comment-14347342 ] Guozhang Wang commented on KAFKA-1863: -- Add some more docs in the possible exception

Re: [VOTE] KIP-2 - Refactor brokers to allow listening on multiple ports and IPs

2015-03-04 Thread Jun Rao
+1 Thanks, Jun On Tue, Mar 3, 2015 at 12:14 PM, Gwen Shapira wrote: > Details are in the wiki: > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-2+-+Refactor+brokers+to+allow+listening+on+multiple+ports+and+IPs >

Review Request 31742: Patch for KAFKA-527

2015-03-04 Thread Yasuhiro Matsuda
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31742/ --- Review request for kafka. Bugs: KAFKA-527 https://issues.apache.org/jira/br

[jira] [Commented] (KAFKA-527) Compression support does numerous byte copies

2015-03-04 Thread Yasuhiro Matsuda (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347441#comment-14347441 ] Yasuhiro Matsuda commented on KAFKA-527: Created reviewboard https://reviews.apache

[jira] [Updated] (KAFKA-527) Compression support does numerous byte copies

2015-03-04 Thread Yasuhiro Matsuda (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yasuhiro Matsuda updated KAFKA-527: --- Attachment: KAFKA-527.patch > Compression support does numerous byte copies > -

[jira] [Updated] (KAFKA-527) Compression support does numerous byte copies

2015-03-04 Thread Yasuhiro Matsuda (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yasuhiro Matsuda updated KAFKA-527: --- Assignee: Yasuhiro Matsuda Status: Patch Available (was: Open) > Compression support doe

[jira] [Commented] (KAFKA-527) Compression support does numerous byte copies

2015-03-04 Thread Yasuhiro Matsuda (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347478#comment-14347478 ] Yasuhiro Matsuda commented on KAFKA-527: This patch introduces BufferingOutputStrea

Re: [KIP-DISCUSSION] KIP-7 Security - IP Filtering

2015-03-04 Thread Joel Koshy
Thanks for confirming. My sample-set is obviously limited to the companies where I have worked - where operations folks do have root access on the services that they manage. That said, it seems fairly straightforward to add this and would help users who don't have the benefit of su privileges. Jo

[jira] [Commented] (KAFKA-1998) Partitions Missing From MetadataResponse

2015-03-04 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347645#comment-14347645 ] Mayuresh Gharat commented on KAFKA-1998: I suppose what we need to do is top expos

[jira] [Created] (KAFKA-2003) Add upgrade tests

2015-03-04 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-2003: --- Summary: Add upgrade tests Key: KAFKA-2003 URL: https://issues.apache.org/jira/browse/KAFKA-2003 Project: Kafka Issue Type: Improvement Reporter: G

[jira] [Commented] (KAFKA-1998) Partitions Missing From MetadataResponse

2015-03-04 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347740#comment-14347740 ] Jay Kreps commented on KAFKA-1998: -- This seems like a bug, shouldn't we always return all

Re: Review Request 31706: Patch for KAFKA-1997

2015-03-04 Thread Jiangjie Qin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31706/ --- (Updated March 4, 2015, 11:07 p.m.) Review request for kafka. Bugs: KAFKA-199

[jira] [Updated] (KAFKA-1997) Refactor Mirror Maker

2015-03-04 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-1997: Attachment: KAFKA-1997_2015-03-04_15:07:46.patch > Refactor Mirror Maker > - > >

[jira] [Commented] (KAFKA-1997) Refactor Mirror Maker

2015-03-04 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347743#comment-14347743 ] Jiangjie Qin commented on KAFKA-1997: - Updated reviewboard https://reviews.apache.org/

Re: Review Request 30126: Patch for KAFKA-1845

2015-03-04 Thread Andrii Biletskyi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30126/ --- (Updated March 4, 2015, 11:12 p.m.) Review request for kafka. Bugs: KAFKA-184

[jira] [Updated] (KAFKA-1845) KafkaConfig should use ConfigDef

2015-03-04 Thread Andrii Biletskyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrii Biletskyi updated KAFKA-1845: Attachment: KAFKA-1845_2015-03-05_01:12:22.patch > KafkaConfig should use ConfigDef > -

[jira] [Commented] (KAFKA-1845) KafkaConfig should use ConfigDef

2015-03-04 Thread Andrii Biletskyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347751#comment-14347751 ] Andrii Biletskyi commented on KAFKA-1845: - Updated reviewboard https://reviews.apa

Re: Review Request 31706: Patch for KAFKA-1997

2015-03-04 Thread Jiangjie Qin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31706/ --- (Updated March 4, 2015, 11:42 p.m.) Review request for kafka. Bugs: KAFKA-199

[jira] [Commented] (KAFKA-1997) Refactor Mirror Maker

2015-03-04 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347790#comment-14347790 ] Jiangjie Qin commented on KAFKA-1997: - Updated reviewboard https://reviews.apache.org/

[jira] [Updated] (KAFKA-1997) Refactor Mirror Maker

2015-03-04 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-1997: Attachment: KAFKA-1997_2015-03-04_15:42:45.patch > Refactor Mirror Maker > - > >

[KIP-DISCUSSION] KIP-13 Quotas

2015-03-04 Thread Aditya Auradkar
Posted a KIP for quotas in kafka. https://cwiki.apache.org/confluence/display/KAFKA/KIP-13+-+Quotas Appreciate any feedback. Aditya

[jira] [Commented] (KAFKA-1313) Support adding replicas to existing topic partitions

2015-03-04 Thread Geoffrey Anderson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347795#comment-14347795 ] Geoffrey Anderson commented on KAFKA-1313: -- Quoting the Kafka docs: The first ste

[jira] [Commented] (KAFKA-2003) Add upgrade tests

2015-03-04 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347804#comment-14347804 ] Ashish K Singh commented on KAFKA-2003: --- [~gwenshap] does the following outline make

[jira] [Comment Edited] (KAFKA-2003) Add upgrade tests

2015-03-04 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347804#comment-14347804 ] Ashish K Singh edited comment on KAFKA-2003 at 3/4/15 11:57 PM:

[jira] [Created] (KAFKA-2004) Write Kafka messages directly to HDFS

2015-03-04 Thread sutanu das (JIRA)
sutanu das created KAFKA-2004: - Summary: Write Kafka messages directly to HDFS Key: KAFKA-2004 URL: https://issues.apache.org/jira/browse/KAFKA-2004 Project: Kafka Issue Type: Bug Compo

[jira] [Commented] (KAFKA-2004) Write Kafka messages directly to HDFS

2015-03-04 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347828#comment-14347828 ] Jiangjie Qin commented on KAFKA-2004: - Is it just a question or it is a ticket to be f

Re: [VOTE] KIP-2 - Refactor brokers to allow listening on multiple ports and IPs

2015-03-04 Thread Joel Koshy
+1 binding On Tue, Mar 03, 2015 at 12:14:33PM -0800, Gwen Shapira wrote: > Details are in the wiki: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-2+-+Refactor+brokers+to+allow+listening+on+multiple+ports+and+IPs

Re: [DISCUSS] KIP-6 - New reassignment partition logic for re-balancing

2015-03-04 Thread Todd Palino
Apologize for the late comment on this... So fair assignment by count (taking into account the current partition count of each broker) is very good. However, it's worth noting that all partitions are not created equal. We have actually been performing more rebalance work based on the partition siz

[jira] [Commented] (KAFKA-1926) Replace kafka.utils.Utils with o.a.k.common.utils.Utils

2015-03-04 Thread Tong Li (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14348038#comment-14348038 ] Tong Li commented on KAFKA-1926: Jay, I finally put together a new patch set just for this

Error when submit a patch set which contains a file rename.

2015-03-04 Thread Tong Li
Hi, I was trying to submit a patch set for review. In this patch set, I removed one file and created another to replace the removed. However, when I run kafka-patch-review.py I got an error. python kafka-patch-review.py -b origin/trunk -j KAFKA-1926 Configuring reviewboard url to https://reviews.a

Re: [DISCUSS] KIP-6 - New reassignment partition logic for re-balancing

2015-03-04 Thread Tong Li
Todd, I think plugable design is good with solid default. The only issue I feel is when you use one and switch to another, will we end up with some unread messages hanging around and no one thinks or knows it is their responsibility to take care of them? Thanks. Tong Sent from my iPhone >

[jira] [Commented] (KAFKA-1998) Partitions Missing From MetadataResponse

2015-03-04 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14348072#comment-14348072 ] Evan Huus commented on KAFKA-1998: -- It's no longer clear to me, based on [~junrao]'s foll

Re: [kafka-clients] Re: [VOTE] 0.8.2.1 Candidate 2

2015-03-04 Thread Neha Narkhede
+1. Verified quick start, unit tests. On Tue, Mar 3, 2015 at 12:09 PM, Joe Stein wrote: > Ok, lets fix the transient test failure on trunk agreed not a blocker. > > +1 quick start passed, verified artifacts, updates in scala > https://github.com/stealthly/scala-kafka/tree/0.8.2.1 and go > https:

Re: [VOTE] KIP-2 - Refactor brokers to allow listening on multiple ports and IPs

2015-03-04 Thread Gwen Shapira
Thanks guys! We have 4 binding +1, 2 non-binding +1 and no -1. I'll update the wiki that this proposal is accepted. If you want to comment on the implementation, feel free to take a look at KAFKA-1809 :) Gwen On Wed, Mar 4, 2015 at 6:31 PM, Joel Koshy wrote: > +1 binding > > On Tue, Mar 03,