[jira] [Created] (KAFKA-1431) ConsoleConsumer - Option to clean zk consumer path

2014-04-30 Thread Jeremy A Laycock (JIRA)
Jeremy A Laycock created KAFKA-1431: --- Summary: ConsoleConsumer - Option to clean zk consumer path Key: KAFKA-1431 URL: https://issues.apache.org/jira/browse/KAFKA-1431 Project: Kafka Issue

[jira] [Commented] (KAFKA-1426) Rebalance issue on 0.8.1

2014-04-30 Thread Jeremy A Laycock (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985265#comment-13985265 ] Jeremy A Laycock commented on KAFKA-1426: - raised KAFKA-1431 to cover this work -

[jira] [Resolved] (KAFKA-1426) Rebalance issue on 0.8.1

2014-04-30 Thread Jeremy A Laycock (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy A Laycock resolved KAFKA-1426. - Resolution: Done will be resolved under separate ticket > Rebalance issue on 0.8.1 > ---

[jira] [Commented] (KAFKA-1429) Yet another deadlock in controller shutdown

2014-04-30 Thread Dmitry Bugaychenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985300#comment-13985300 ] Dmitry Bugaychenko commented on KAFKA-1429: --- Yes, we have auto.leader.rebalance.

[jira] [Updated] (KAFKA-1431) ConsoleConsumer - Option to clean zk consumer path

2014-04-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1431: --- Assignee: (was: Neha Narkhede) Labels: newbie (was: ) > ConsoleConsumer - Option to clean zk consu

[jira] [Commented] (KAFKA-1429) Yet another deadlock in controller shutdown

2014-04-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985558#comment-13985558 ] Jun Rao commented on KAFKA-1429: Probably in a month or two. > Yet another deadlock in co

[jira] [Commented] (KAFKA-1032) Messages sent to the old leader will be lost on broker GC resulted failure

2014-04-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985581#comment-13985581 ] Jun Rao commented on KAFKA-1032: It seems that the main thing that this jira is trying to

[jira] [Commented] (KAFKA-1342) Slow controlled shutdowns can result in stale shutdown requests

2014-04-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985593#comment-13985593 ] Jun Rao commented on KAFKA-1342: If it's just a matter of configuring the timeout, could w

[jira] [Comment Edited] (KAFKA-1029) Zookeeper leader election stuck in ephemeral node retry loop

2014-04-30 Thread Michael Noll (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985617#comment-13985617 ] Michael Noll edited comment on KAFKA-1029 at 4/30/14 3:27 PM: --

[jira] [Commented] (KAFKA-1029) Zookeeper leader election stuck in ephemeral node retry loop

2014-04-30 Thread Michael Noll (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985617#comment-13985617 ] Michael Noll commented on KAFKA-1029: - I could finally reproduce the bug again, though

[jira] [Comment Edited] (KAFKA-1029) Zookeeper leader election stuck in ephemeral node retry loop

2014-04-30 Thread Michael Noll (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985617#comment-13985617 ] Michael Noll edited comment on KAFKA-1029 at 4/30/14 3:32 PM: --

[jira] [Comment Edited] (KAFKA-1029) Zookeeper leader election stuck in ephemeral node retry loop

2014-04-30 Thread Michael Noll (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985617#comment-13985617 ] Michael Noll edited comment on KAFKA-1029 at 4/30/14 3:33 PM: --

[jira] [Closed] (KAFKA-1032) Messages sent to the old leader will be lost on broker GC resulted failure

2014-04-30 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang closed KAFKA-1032. > Messages sent to the old leader will be lost on broker GC resulted failure >

[jira] [Commented] (KAFKA-1032) Messages sent to the old leader will be lost on broker GC resulted failure

2014-04-30 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985740#comment-13985740 ] Guozhang Wang commented on KAFKA-1032: -- Confirmed that the StopReplicaRequest is sent

[jira] [Updated] (KAFKA-1032) Messages sent to the old leader will be lost on broker GC resulted failure

2014-04-30 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1032: - Resolution: Fixed Status: Resolved (was: Patch Available) > Messages sent to the old lea

[jira] [Commented] (KAFKA-1425) provide logStartOffset in addition to LogEndOffset metric

2014-04-30 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985778#comment-13985778 ] Neha Narkhede commented on KAFKA-1425: -- Thanks for the patch. Overall, looks good. Ho

[jira] [Updated] (KAFKA-1430) Purgatory redesign

2014-04-30 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1430: - Description: We have seen 2 main issues with the Purgatory. 1. There is no atomic checkAndWatch

[jira] [Commented] (KAFKA-1430) Purgatory redesign

2014-04-30 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985890#comment-13985890 ] Jay Kreps commented on KAFKA-1430: -- Hey guys, this is more like two issues in our use of

[jira] [Commented] (KAFKA-1300) Added WaitForReplaction admin tool.

2014-04-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985929#comment-13985929 ] Joel Koshy commented on KAFKA-1300: --- Is this needed given that controlled shutdown is in

[jira] [Commented] (KAFKA-1342) Slow controlled shutdowns can result in stale shutdown requests

2014-04-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985930#comment-13985930 ] Joel Koshy commented on KAFKA-1342: --- We could, but I think the underlying issue is serio

[jira] [Commented] (KAFKA-1300) Added WaitForReplaction admin tool.

2014-04-30 Thread Brenden Matthews (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985938#comment-13985938 ] Brenden Matthews commented on KAFKA-1300: - This tool is orthogonal to the controll

[jira] [Commented] (KAFKA-1425) provide logStartOffset in addition to LogEndOffset metric

2014-04-30 Thread alexcb (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985940#comment-13985940 ] alexcb commented on KAFKA-1425: --- Created reviewboard against branch origin/trunk > provide

[jira] [Updated] (KAFKA-1425) provide logStartOffset in addition to LogEndOffset metric

2014-04-30 Thread alexcb (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alexcb updated KAFKA-1425: -- Attachment: (was: add-start-offset-to-kafka.patch) > provide logStartOffset in addition to LogEndOffset met

[jira] [Updated] (KAFKA-1425) provide logStartOffset in addition to LogEndOffset metric

2014-04-30 Thread alexcb (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alexcb updated KAFKA-1425: -- Attachment: KAFKA-1425.patch > provide logStartOffset in addition to LogEndOffset metric >

[jira] [Commented] (KAFKA-1425) provide logStartOffset in addition to LogEndOffset metric

2014-04-30 Thread alexcb (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985942#comment-13985942 ] alexcb commented on KAFKA-1425: --- Thanks Neha -- I've updated the patch using the kafka-patch

[jira] [Commented] (KAFKA-1425) provide logStartOffset in addition to LogEndOffset metric

2014-04-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986027#comment-13986027 ] Joel Koshy commented on KAFKA-1425: --- You might have run into some issues with the patch

[jira] [Commented] (KAFKA-1300) Added WaitForReplaction admin tool.

2014-04-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986026#comment-13986026 ] Joel Koshy commented on KAFKA-1300: --- Understood, but the primary use case would be to pr

[jira] [Commented] (KAFKA-1430) Purgatory redesign

2014-04-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986069#comment-13986069 ] Jun Rao commented on KAFKA-1430: Could you list those shortcomings? > Purgatory redesign

[jira] [Commented] (KAFKA-1305) Controller can hang on controlled shutdown with auto leader balance enabled

2014-04-30 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986087#comment-13986087 ] Andrew Olson commented on KAFKA-1305: - Is it recommended to not set both auto.leader.r

Re: Review Request 20745: Patch for KAFKA-1397

2014-04-30 Thread Timothy Chen
> On April 29, 2014, 5:02 p.m., Jun Rao wrote: > > core/src/main/scala/kafka/controller/ControllerChannelManager.scala, lines > > 209-212 > > > > > > Is it better to do the check here or in the caller? Hmm, at first

Re: Review Request 20745: Patch for KAFKA-1397

2014-04-30 Thread Timothy Chen
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20745/ --- (Updated April 30, 2014, 9:55 p.m.) Review request for kafka. Bugs: KAFKA-139

[jira] [Commented] (KAFKA-1397) delete topic is not working

2014-04-30 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986142#comment-13986142 ] Timothy Chen commented on KAFKA-1397: - Updated reviewboard https://reviews.apache.org/

[jira] [Updated] (KAFKA-1397) delete topic is not working

2014-04-30 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Chen updated KAFKA-1397: Attachment: KAFKA-1397_2014-04-30_14:55:28.patch > delete topic is not working > -

[jira] [Commented] (KAFKA-1425) provide logStartOffset in addition to LogEndOffset metric

2014-04-30 Thread alexcb (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986195#comment-13986195 ] alexcb commented on KAFKA-1425: --- Created reviewboard against branch trunk > provide logSta

[jira] [Updated] (KAFKA-1425) provide logStartOffset in addition to LogEndOffset metric

2014-04-30 Thread alexcb (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alexcb updated KAFKA-1425: -- Attachment: KAFKA-1425.patch > provide logStartOffset in addition to LogEndOffset metric >

[jira] [Commented] (KAFKA-1425) provide logStartOffset in addition to LogEndOffset metric

2014-04-30 Thread alexcb (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986199#comment-13986199 ] alexcb commented on KAFKA-1425: --- yup sure enough, the kafka-patch-review.py does not appear

[jira] [Updated] (KAFKA-1425) provide logStartOffset in addition to LogEndOffset metric

2014-04-30 Thread alexcb (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alexcb updated KAFKA-1425: -- Attachment: KAFKA-1425.patch > provide logStartOffset in addition to LogEndOffset metric >

[jira] [Commented] (KAFKA-1425) provide logStartOffset in addition to LogEndOffset metric

2014-04-30 Thread alexcb (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986202#comment-13986202 ] alexcb commented on KAFKA-1425: --- Created reviewboard against branch trunk > provide logSta

Review Request 20927: Added metric to track the minimum offset for each topic/partition

2014-04-30 Thread Alex Couture-Beil
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20927/ --- Review request for kafka. Repository: kafka Description --- Added metric

[jira] [Commented] (KAFKA-1425) provide logStartOffset in addition to LogEndOffset metric

2014-04-30 Thread alexcb (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986215#comment-13986215 ] alexcb commented on KAFKA-1425: --- the "post-review" command has been removed in the latest re

[jira] [Created] (KAFKA-1432) Make num.producerThreads configurable on new MirrrorMaker

2014-04-30 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-1432: Summary: Make num.producerThreads configurable on new MirrrorMaker Key: KAFKA-1432 URL: https://issues.apache.org/jira/browse/KAFKA-1432 Project: Kafka Issue

[jira] [Created] (KAFKA-1433) transient unit test failure in ZookeeperConsumerConnectorTest

2014-04-30 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-1433: -- Summary: transient unit test failure in ZookeeperConsumerConnectorTest Key: KAFKA-1433 URL: https://issues.apache.org/jira/browse/KAFKA-1433 Project: Kafka Issue Type:

Review Request 20930: Patch for KAFKA-1433

2014-04-30 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20930/ --- Review request for kafka. Bugs: KAFKA-1433 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-1433) transient unit test failure in ZookeeperConsumerConnectorTest

2014-04-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986238#comment-13986238 ] Jun Rao commented on KAFKA-1433: Created reviewboard https://reviews.apache.org/r/20930/

[jira] [Updated] (KAFKA-1433) transient unit test failure in ZookeeperConsumerConnectorTest

2014-04-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1433: --- Attachment: KAFKA-1433.patch > transient unit test failure in ZookeeperConsumerConnectorTest > --

Re: Review Request 20927: Added metric to track the minimum offset for each topic/partition

2014-04-30 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20927/#review41897 --- Ship it! Ship It! - Joel Koshy On April 30, 2014, 11:26 p.m., Al