Re: [DISCUSSION] Partition Selection and Coordination By Brokers for Producers

2015-06-05 Thread Bhavesh Mistry
Thanks for the info Jun. Each broker (that host topic) has the latest (end) offset for each topic and partition ? If yes, I was planning to use this rate-of-change vs incoming injection rate of producer (only calculated for the attached producer broker) to make decision to which partition would

[jira] [Commented] (KAFKA-2253) Deadlock in delayed operation purgatory

2015-06-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575411#comment-14575411 ] Guozhang Wang commented on KAFKA-2253: -- Thanks [~mgharat] for the find, I will take a

[jira] [Updated] (KAFKA-2253) Deadlock in delayed operation purgatory

2015-06-05 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Onur Karaman updated KAFKA-2253: Description: We hit a deadlock while running brokers with git hash: 9e894aa0173b14d64a900bcf780d6b7

[jira] [Updated] (KAFKA-2253) Deadlock in delayed operation purgatory

2015-06-05 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Onur Karaman updated KAFKA-2253: Reviewer: (was: Jun Rao) > Deadlock in delayed operation purgatory > -

[jira] [Updated] (KAFKA-2253) Deadlock in delayed operation purgatory

2015-06-05 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Onur Karaman updated KAFKA-2253: Description: We hit a deadlock while running brokers with git hash: 9e894aa0173b14d64a900bcf780d6b7

[jira] [Commented] (KAFKA-2160) DelayedOperationPurgatory should remove the pair in watchersForKey with empty watchers list

2015-06-05 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575390#comment-14575390 ] Mayuresh Gharat commented on KAFKA-2160: We hit a deadlock while running brokers w

[jira] [Created] (KAFKA-2253) Deadlock in delayed operation purgatory

2015-06-05 Thread Mayuresh Gharat (JIRA)
Mayuresh Gharat created KAFKA-2253: -- Summary: Deadlock in delayed operation purgatory Key: KAFKA-2253 URL: https://issues.apache.org/jira/browse/KAFKA-2253 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-2232) make MockProducer generic

2015-06-05 Thread Alexander Pakulov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575374#comment-14575374 ] Alexander Pakulov commented on KAFKA-2232: -- [~junrao] Partitioner#partition metho

[jira] [Commented] (KAFKA-2168) New consumer poll() can block other calls like position(), commit(), and close() indefinitely

2015-06-05 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575088#comment-14575088 ] Jason Gustafson commented on KAFKA-2168: Updated reviewboard https://reviews.apach

[jira] [Updated] (KAFKA-2168) New consumer poll() can block other calls like position(), commit(), and close() indefinitely

2015-06-05 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2168: --- Attachment: KAFKA-2168_2015-06-05_12:44:48.patch > New consumer poll() can block other calls l

Re: Review Request 34789: Patch for KAFKA-2168

2015-06-05 Thread Jason Gustafson
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34789/ --- (Updated June 5, 2015, 7:45 p.m.) Review request for kafka. Bugs: KAFKA-2168

Jenkins build is back to normal : Kafka-trunk #505

2015-06-05 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-2168) New consumer poll() can block other calls like position(), commit(), and close() indefinitely

2015-06-05 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575032#comment-14575032 ] Jason Gustafson commented on KAFKA-2168: Updated reviewboard https://reviews.apach

[jira] [Updated] (KAFKA-2168) New consumer poll() can block other calls like position(), commit(), and close() indefinitely

2015-06-05 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2168: --- Attachment: KAFKA-2168_2015-06-05_12:01:28.patch > New consumer poll() can block other calls l

Re: Review Request 34789: Patch for KAFKA-2168

2015-06-05 Thread Jason Gustafson
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34789/ --- (Updated June 5, 2015, 7:02 p.m.) Review request for kafka. Bugs: KAFKA-2168

[jira] [Updated] (KAFKA-2246) UnknownTopicOrPartitionException should be an instance of InvalidMetadataException

2015-06-05 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-2246: -- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch - pushed to trun

[jira] [Commented] (KAFKA-2147) Unbalanced replication can cause extreme purgatory growth

2015-06-05 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574985#comment-14574985 ] Evan Huus commented on KAFKA-2147: -- We have rolled out a custom build with this patch to

Re: Review Request 35023: Patch for KAFKA-2246

2015-06-05 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35023/#review86757 --- Ship it! We will want to revisit this as part of the changes in KIP

[jira] [Commented] (KAFKA-1682) Security for Kafka

2015-06-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574717#comment-14574717 ] Guozhang Wang commented on KAFKA-1682: -- [~sriharsha] That makes sense, thanks! > Sec