[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Alexey Ozeritskiy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067872#comment-14067872 ] Alexey Ozeritskiy commented on KAFKA-1414: -- Anton, your patch is not working for

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067884#comment-14067884 ] Anton Karamanov commented on KAFKA-1414: [~aozeritsky] are you testing shutdown or

[jira] [Comment Edited] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067884#comment-14067884 ] Anton Karamanov edited comment on KAFKA-1414 at 7/20/14 11:07 AM: --

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Alexey Ozeritskiy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067917#comment-14067917 ] Alexey Ozeritskiy commented on KAFKA-1414: -- You must create an instance of Runnab

[jira] [Comment Edited] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Alexey Ozeritskiy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067917#comment-14067917 ] Alexey Ozeritskiy edited comment on KAFKA-1414 at 7/20/14 12:48 PM:

[jira] [Comment Edited] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Alexey Ozeritskiy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067917#comment-14067917 ] Alexey Ozeritskiy edited comment on KAFKA-1414 at 7/20/14 12:54 PM:

Re: Review Request 23702: Patch for KAFKA-1070

2014-07-20 Thread Sriharsha Chintalapani
> On July 19, 2014, 11:28 p.m., Timothy Chen wrote: > > core/src/main/scala/kafka/server/KafkaConfig.scala, line 64 > > > > > > Why reduce the range to 1000? > > As we go with auto-generating broker id we want to have

Re: Review Request 23702: Patch for KAFKA-1070

2014-07-20 Thread Timothy Chen
> On July 19, 2014, 11:28 p.m., Timothy Chen wrote: > > core/src/main/scala/kafka/server/KafkaConfig.scala, line 64 > > > > > > Why reduce the range to 1000? > > > > Sriharsha Chintalapani wrote: > As we go with a

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Oleg Golovin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067986#comment-14067986 ] Oleg Golovin commented on KAFKA-1414: - [~ataraxer], you seem to run all the threadpool

[jira] [Resolved] (KAFKA-1551) Configuration example errors

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1551. -- Resolution: Fixed Fixed. > Configuration example errors > > >

[jira] [Updated] (KAFKA-1552) Quickstart refers to wrong port in pastable commands

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1552: - Assignee: Olle Jonsson > Quickstart refers to wrong port in pastable commands > -

[jira] [Updated] (KAFKA-1552) Quickstart refers to wrong port in pastable commands

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1552: - Resolution: Fixed Status: Resolved (was: Patch Available) Fixed, thanks! > Quickstart refers to

[jira] [Updated] (KAFKA-1551) Configuration example errors

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1551: - Assignee: Alexey Ozeritskiy > Configuration example errors > > >

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068007#comment-14068007 ] Anton Karamanov commented on KAFKA-1414: I see the problem now. I still think that

[jira] [Commented] (KAFKA-1539) Due to OS caching Kafka might loose offset files which causes full reset of data

2014-07-20 Thread Dmitry Bugaychenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068010#comment-14068010 ] Dmitry Bugaychenko commented on KAFKA-1539: --- Digged the proble a bit more. It lo

[jira] [Comment Edited] (KAFKA-1539) Due to OS caching Kafka might loose offset files which causes full reset of data

2014-07-20 Thread Dmitry Bugaychenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068010#comment-14068010 ] Dmitry Bugaychenko edited comment on KAFKA-1539 at 7/20/14 6:30 PM:

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Dmitry Bugaychenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068013#comment-14068013 ] Dmitry Bugaychenko commented on KAFKA-1414: --- In our use case inter-directory par

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Oleg Golovin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068014#comment-14068014 ] Oleg Golovin commented on KAFKA-1414: - I see only one problem here. If we disperse thr

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Dmitry Bugaychenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068015#comment-14068015 ] Dmitry Bugaychenko commented on KAFKA-1414: --- That is why in my initial proposal

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Oleg Golovin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068018#comment-14068018 ] Oleg Golovin commented on KAFKA-1414: - [~junrao] wrote about parallelization over dire

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Dmitry Bugaychenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068020#comment-14068020 ] Dmitry Bugaychenko commented on KAFKA-1414: --- Separate thread pool per each dir w

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068021#comment-14068021 ] Jay Kreps commented on KAFKA-1414: -- We should check that having multiple threads accessin

Improved site docs on how to contribute

2014-07-20 Thread Jay Kreps
Following up on the recent contributor thread I tried to improve the docs on how to contribute to Kafka: http://kafka.apache.org/contributing.html Let me know if anyone has any additional suggestions on what should be there. -Jay

[jira] [Updated] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Karamanov updated KAFKA-1414: --- Attachment: KAFKA-1414-rev3-interleaving.patch Log-level parallelization is better in any cas

[jira] [Comment Edited] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068047#comment-14068047 ] Anton Karamanov edited comment on KAFKA-1414 at 7/20/14 9:14 PM: ---

Re: Review Request 23697: Fix KAFKA-1533: Address Jun and Neha's comments

2014-07-20 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23697/#review48194 --- clients/src/main/java/org/apache/kafka/clients/NetworkClient.java <

[jira] [Commented] (KAFKA-1549) dead brokers coming in the TopicMetadataResponse

2014-07-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068165#comment-14068165 ] Jun Rao commented on KAFKA-1549: Thanks for the patch. A couple of comments. 1. inReadLoc

Re: Review Request 23705: Patch for KAFKA-1192

2014-07-20 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23705/#review48195 --- Thanks for the patch. A couple of comments below. core/src/main/sc

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068173#comment-14068173 ] Jay Kreps commented on KAFKA-1414: -- I did a test of single-threaded recovery on my laptop

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068177#comment-14068177 ] Jay Kreps commented on KAFKA-1414: -- [~ataraxer] I agree that just throwing all the logs a

[jira] [Commented] (KAFKA-1451) Broker stuck due to leader election race

2014-07-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068193#comment-14068193 ] Jun Rao commented on KAFKA-1451: Neha, I am not sure if #1 is need. We can get into elect

[jira] [Commented] (KAFKA-1546) Automate replica lag tuning

2014-07-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068209#comment-14068209 ] Jun Rao commented on KAFKA-1546: Jay, I think what you proposed is nice and simple. I thin