Re: Review Request 32890: Patch for conrolled shutdown rebase on trunk

2015-04-09 Thread Jiangjie Qin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32890/#review79533 --- Thanks for the patch. Interesting improvement. Some comments below.

Jenkins build is back to normal : Kafka-trunk #458

2015-04-09 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-1367) Broker topic metadata not kept in sync with ZooKeeper

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14488218#comment-14488218 ] Jun Rao commented on KAFKA-1367: [~Skandragon], for the operational issue that you pointed

Build failed in Jenkins: KafkaPreCommit #70

2015-04-09 Thread Apache Jenkins Server
See Changes: [junrao] kafka-2112; make overflowWheel volatile; patched by Yasuhiro Matsuda; reviewed by Jun Rao -- [...truncated 1521 lines...] at sun.nio.ch.FileChannelImpl.map(FileChannel

[jira] [Commented] (KAFKA-1367) Broker topic metadata not kept in sync with ZooKeeper

2015-04-09 Thread Michael Graff (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14488058#comment-14488058 ] Michael Graff commented on KAFKA-1367: -- There is another issue that no one seems to b

[jira] [Updated] (KAFKA-2112) make overflowWheel volatile

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2112: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for t

[jira] [Commented] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-04-09 Thread Aravind (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487954#comment-14487954 ] Aravind commented on KAFKA-2078: Hi, no OOME on broker or client. Else I would have defin

[jira] [Commented] (KAFKA-2112) make overflowWheel volatile

2015-04-09 Thread Yasuhiro Matsuda (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487830#comment-14487830 ] Yasuhiro Matsuda commented on KAFKA-2112: - Created reviewboard https://reviews.apa

[jira] [Updated] (KAFKA-2112) make overflowWheel volatile

2015-04-09 Thread Yasuhiro Matsuda (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yasuhiro Matsuda updated KAFKA-2112: Attachment: KAFKA-2112.patch > make overflowWheel volatile > --- > >

[jira] [Updated] (KAFKA-2112) make overflowWheel volatile

2015-04-09 Thread Yasuhiro Matsuda (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yasuhiro Matsuda updated KAFKA-2112: Assignee: Yasuhiro Matsuda (was: Joel Koshy) Status: Patch Available (was: Open) > m

Review Request 33028: Patch for KAFKA-2112

2015-04-09 Thread Yasuhiro Matsuda
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33028/ --- Review request for kafka. Bugs: KAFKA-2112 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-2057) DelayedOperationTest.testRequestExpiry transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487804#comment-14487804 ] Rajini Sivaram commented on KAFKA-2057: --- There is a small timing window in the test

[jira] [Updated] (KAFKA-2057) DelayedOperationTest.testRequestExpiry transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-2057: -- Assignee: Rajini Sivaram Status: Patch Available (was: Open) > DelayedOperationTest.testR

[jira] [Commented] (KAFKA-2057) DelayedOperationTest.testRequestExpiry transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487785#comment-14487785 ] Rajini Sivaram commented on KAFKA-2057: --- Created reviewboard https://reviews.apache.

[jira] [Updated] (KAFKA-2057) DelayedOperationTest.testRequestExpiry transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-2057: -- Attachment: KAFKA-2057.patch > DelayedOperationTest.testRequestExpiry transient failure > --

Review Request 33027: Fix timing issue in DelayedOperationTest

2015-04-09 Thread Rajini Sivaram
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33027/ --- Review request for kafka. Bugs: KAFKA-2057 https://issues.apache.org/jira/b

[jira] [Created] (KAFKA-2112) make overflowWheel volatile

2015-04-09 Thread Yasuhiro Matsuda (JIRA)
Yasuhiro Matsuda created KAFKA-2112: --- Summary: make overflowWheel volatile Key: KAFKA-2112 URL: https://issues.apache.org/jira/browse/KAFKA-2112 Project: Kafka Issue Type: Bug Com

[jira] [Updated] (KAFKA-1788) producer record can stay in RecordAccumulator forever if leader is no available

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1788: --- Assignee: Parth Brahmbhatt (was: Jun Rao) > producer record can stay in RecordAccumulator forever if leader i

[jira] [Updated] (KAFKA-1933) Fine-grained locking in log append

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1933: --- Assignee: Maxim Ivanov (was: Jay Kreps) > Fine-grained locking in log append > --

[jira] [Updated] (KAFKA-1933) Fine-grained locking in log append

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1933: --- Status: Patch Available (was: Open) > Fine-grained locking in log append > --

[jira] [Updated] (KAFKA-2036) Consumer and broker have different networks

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2036: --- Status: Patch Available (was: Open) > Consumer and broker have different networks > -

[jira] [Updated] (KAFKA-2109) Support retries in KafkaLog4jAppender

2015-04-09 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2109: Assignee: Dave Beech (was: Jun Rao) > Support retries in KafkaLog4jAppender > -

Re: [KIP-DISCUSSION] KIP-13 Quotas

2015-04-09 Thread Jun Rao
Since we are also thinking about evolving the fetch request protocol in KAFKA-2063 (bound fetch response size), perhaps it's worth thinking through if we can just evolve the protocol once. Thanks, Jun On Wed, Apr 8, 2015 at 10:43 AM, Aditya Auradkar < aaurad...@linkedin.com.invalid> wrote: > Th

Re: jira backlogs

2015-04-09 Thread Jun Rao
Gwen, Kafka jira is configured to allow contributors to edit and transition issues. So, not sure why you can't assign yourself as a reviewer. If you still have the problem, could you file an infra jira? Thanks, Jun On Wed, Apr 8, 2015 at 9:41 AM, Gwen Shapira wrote: > One more thing: I curren

[jira] [Commented] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

2015-04-09 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487555#comment-14487555 ] Benoy Antony commented on KAFKA-2077: - Use case is as below : We are using a system a

[jira] [Commented] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

2015-04-09 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487557#comment-14487557 ] Benoy Antony commented on KAFKA-2077: - Yes. > Add ability to specify a TopicPicker cl

[jira] [Commented] (KAFKA-2089) MetadataTest transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487550#comment-14487550 ] Rajini Sivaram commented on KAFKA-2089: --- There was a race condition in asyncFetch wh

[jira] [Updated] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2077: --- Reviewer: (was: Gwen Shapira) > Add ability to specify a TopicPicker class for KafkaLog4jApender > -

[jira] [Updated] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2077: --- Reviewer: Gwen Shapira > Add ability to specify a TopicPicker class for KafkaLog4jApender > --

[jira] [Updated] (KAFKA-2089) MetadataTest transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-2089: -- Attachment: KAFKA-2089.patch > MetadataTest transient failure > -- >

[jira] [Commented] (KAFKA-2089) MetadataTest transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487535#comment-14487535 ] Rajini Sivaram commented on KAFKA-2089: --- Created reviewboard https://reviews.apache.

[jira] [Updated] (KAFKA-2089) MetadataTest transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-2089: -- Assignee: Rajini Sivaram Status: Patch Available (was: Open) > MetadataTest transient fai

Review Request 33017: Fix timing issue in MetadataTest

2015-04-09 Thread Rajini Sivaram
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33017/ --- Review request for kafka. Bugs: KAFKA-2089 https://issues.apache.org/jira/b

Re: [DISCUSS] KIP-18 - JBOD Support

2015-04-09 Thread Todd Palino
I think this is a good start. We've been discussing JBOD internally, so it's good to see a discussion going externally about it as well. The other big blocker to using JBOD is the lack of intelligent partition assignment logic, and the lack of tools to adjust it. The controller is not smart enough

[jira] [Commented] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487473#comment-14487473 ] Sriharsha Chintalapani commented on KAFKA-2082: --- [~junrao] I ran a quick tes

[DISCUSS] KIP-18 - JBOD Support

2015-04-09 Thread Andrii Biletskyi
Hi, Let me start discussion thread for KIP-18 - JBOD Support. Link to wiki: https://cwiki.apache.org/confluence/display/KAFKA/KIP-18+-+JBOD+Support Thanks, Andrii Biletskyi

RE: Is there a complete Kafka 0.8.* replication design document

2015-04-09 Thread Jason Guo (jguo2)
Thanks. When a failed broker recovery, it will truncate its log to the last HW. But how to truncate? For a partition, it will store the log in many segment and one segment is a physical file. How to truncate a file to a specified HW? [cid:image001.png@01D072D5.BD52DFF0] Regards, Jason From: Ju