Review Request 29091: Patch for KAFKA-1646

2014-12-15 Thread Qianlin Xia
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29091/ --- Review request for kafka. Bugs: KAFKA-1646 https://issues.apache.org/jira/b

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) > Improve consumer read performance for Windows >

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch > Improve consumer read performance for Windows > ---

[jira] [Updated] (KAFKA-1720) [Renaming / Comments] Delayed Operations

2014-12-15 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1720: -- Resolution: Fixed Status: Resolved (was: Patch Available) Guozhang committed this to trunk > [

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch > Improve consumer read performance for Windows > ---

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) > Improve consumer read performance for Windows >

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247879#comment-14247879 ] Qianlin Xia commented on KAFKA-1646: Created reviewboard against branch origin/0.8.1

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Comment: was deleted (was: Created reviewboard against branch origin/0.8.1) > Improve consumer read

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Comment: was deleted (was: Created reviewboard against branch origin/0.8.1) > Improve consumer read

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Comment: was deleted (was: Created reviewboard against branch origin/0.8.1) > Improve consumer read

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Comment: was deleted (was: Created reviewboard against branch origin/0.8.1) > Improve consumer read

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) > Improve consumer read performance for Windows >

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) > Improve consumer read performance for Windows >

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Comment: was deleted (was: Created reviewboard against branch origin/0.8.1) > Improve consumer read

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) > Improve consumer read performance for Windows >

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247865#comment-14247865 ] Qianlin Xia commented on KAFKA-1646: Created reviewboard against branch origin/0.8.1

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch > Improve consumer read performance for Windows > ---

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch > Improve consumer read performance for Windows > ---

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247862#comment-14247862 ] Qianlin Xia commented on KAFKA-1646: Created reviewboard against branch origin/0.8.1

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch > Improve consumer read performance for Windows > ---

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247852#comment-14247852 ] Qianlin Xia commented on KAFKA-1646: Created reviewboard against branch origin/0.8.1

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) > Improve consumer read performance for Windows >

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Comment: was deleted (was: Created reviewboard against branch origin/0.8.1) > Improve consumer read

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247843#comment-14247843 ] Qianlin Xia commented on KAFKA-1646: Created reviewboard against branch origin/0.8.1

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch > Improve consumer read performance for Windows > ---

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) > Improve consumer read performance for Windows >

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch > Improve consumer read performance for Windows > ---

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247842#comment-14247842 ] Qianlin Xia commented on KAFKA-1646: Created reviewboard against branch origin/0.8.1

[jira] [Commented] (KAFKA-1788) producer record can stay in RecordAccumulator forever if leader is no available

2014-12-15 Thread Bob Potter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247766#comment-14247766 ] Bob Potter commented on KAFKA-1788: --- I've been digging into this a little bit and in add

Re: [DISCUSSION] adding the serializer api back to the new java producer

2014-12-15 Thread Joel Koshy
Documentation is inevitable even if the serializer/deserializer is part of the API - since the user has to set it up in the configs. So again, you can only encourage people to use it through documentation. The simpler byte-oriented API seems clearer to me because anyone who needs to send (or receiv

[jira] [Commented] (KAFKA-1819) Cleaner gets confused about deleted and re-created topics

2014-12-15 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247661#comment-14247661 ] Gwen Shapira commented on KAFKA-1819: - Yep, looks like a bug. When we delete a topic

[jira] [Commented] (KAFKA-1806) broker can still expose uncommitted data to a consumer

2014-12-15 Thread lokesh Birla (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247607#comment-14247607 ] lokesh Birla commented on KAFKA-1806: - Neha, I can see this problem quite often. [

[jira] [Updated] (KAFKA-1797) add the serializer/deserializer api to the new java client

2014-12-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1797: --- Attachment: kafka-1797.patch > add the serializer/deserializer api to the new java client > --

[jira] [Commented] (KAFKA-1797) add the serializer/deserializer api to the new java client

2014-12-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247520#comment-14247520 ] Jun Rao commented on KAFKA-1797: Created reviewboard https://reviews.apache.org/r/29072/di

Review Request 29072: rebased for 0.8.2 branch

2014-12-15 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29072/ --- Review request for kafka. Bugs: kafka-1797 https://issues.apache.org/jira/b

Re: Review Request 28423: Patch for kafka-1797

2014-12-15 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28423/#review65153 --- Ship it! Ship It! - Neha Narkhede On Dec. 15, 2014, 11:36 p.m.,

[jira] [Updated] (KAFKA-1797) add the serializer/deserializer api to the new java client

2014-12-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1797: --- Attachment: kafka-1797_2014-12-15_15:36:24.patch > add the serializer/deserializer api to the new java client

[jira] [Commented] (KAFKA-1797) add the serializer/deserializer api to the new java client

2014-12-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247433#comment-14247433 ] Jun Rao commented on KAFKA-1797: Updated reviewboard https://reviews.apache.org/r/28423/di

Re: Review Request 28423: Patch for kafka-1797

2014-12-15 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28423/ --- (Updated Dec. 15, 2014, 11:36 p.m.) Review request for kafka. Bugs: kafka-179

Re: Review Request 29029: Patch for KAFKA-1512

2014-12-15 Thread Jeff Holoman
> On Dec. 15, 2014, 7:58 p.m., Gwen Shapira wrote: > > Jeff, > > > > There's some strange things going on there, I think we need a bit more > > testing and maybe more implementation :) > > > > 1. Please make sure the test fails without the override fix. When I tried, > > it passed on trunk...

Re: spark kafka batch integration

2014-12-15 Thread Koert Kuipers
gwen, i thought about it a little more and i feel pretty confident i can make it so that it's deterministic in case of node failure. will push that change out after holidays. On Mon, Dec 15, 2014 at 12:03 AM, Koert Kuipers wrote: > > hey gwen, > > no immediate plans to contribute it to spark but

[jira] [Commented] (KAFKA-1820) Kafka Leader not found for Topic and Partition

2014-12-15 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247179#comment-14247179 ] Neha Narkhede commented on KAFKA-1820: -- It is best to discuss these kind of questions

[jira] [Updated] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-15 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1512: - Reviewer: Jay Kreps > Limit the maximum number of connections per ip address > ---

[jira] [Updated] (KAFKA-1819) Cleaner gets confused about deleted and re-created topics

2014-12-15 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1819: - Fix Version/s: 0.8.2 > Cleaner gets confused about deleted and re-created topics > ---

[jira] [Updated] (KAFKA-1819) Cleaner gets confused about deleted and re-created topics

2014-12-15 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1819: - Priority: Blocker (was: Major) > Cleaner gets confused about deleted and re-created topics >

Re: [DISCUSSION] adding the serializer api back to the new java producer

2014-12-15 Thread Jun Rao
Joel, It's just that if the serializer/deserializer is not part of the API, you can only encourage people to use it through documentation. However, not everyone will read the documentation if it's not directly used in the API. Thanks, Jun On Mon, Dec 15, 2014 at 2:11 AM, Joel Koshy wrote: > (

Re: Review Request 29029: Patch for KAFKA-1512

2014-12-15 Thread Gwen Shapira
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29029/#review65114 --- Jeff, There's some strange things going on there, I think we need a

[jira] [Updated] (KAFKA-1821) Example shell scripts broken

2014-12-15 Thread Yong Fu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yong Fu updated KAFKA-1821: --- Environment: Ubuntu 14.04, Linux 75477193b766 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014 x8

[jira] [Created] (KAFKA-1821) Example shell scripts broken

2014-12-15 Thread Yong Fu (JIRA)
Yong Fu created KAFKA-1821: -- Summary: Example shell scripts broken Key: KAFKA-1821 URL: https://issues.apache.org/jira/browse/KAFKA-1821 Project: Kafka Issue Type: Bug Components: packagin

[jira] [Commented] (KAFKA-742) Existing directories under the Kafka data directory without any data cause process to not start

2014-12-15 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246883#comment-14246883 ] Gwen Shapira commented on KAFKA-742: I think we need to print the full path to the dire

[jira] [Created] (KAFKA-1820) Kafka Leader not found for Topic and Partition

2014-12-15 Thread Ashendra Bansal (JIRA)
Ashendra Bansal created KAFKA-1820: -- Summary: Kafka Leader not found for Topic and Partition Key: KAFKA-1820 URL: https://issues.apache.org/jira/browse/KAFKA-1820 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-1804) Kafka network thread lacks top exception handler

2014-12-15 Thread Oleg Golovin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246599#comment-14246599 ] Oleg Golovin commented on KAFKA-1804: - `kafka-socket-acceptor` has the same problem.

Re: [DISCUSSION] adding the serializer api back to the new java producer

2014-12-15 Thread Joel Koshy
(sorry about the late follow-up late - I'm traveling most of this month) I'm likely missing something obvious, but I find the following to be a somewhat vague point that has been mentioned more than once in this thread without a clear explanation. i.e., why is it hard to share a serializer/deseria