[jira] [Created] (KAFKA-1901) Move Kafka version to be generated in code by build (instead of in manifest)

Jason Rosenberg created KAFKA-1901: -- Summary: Move Kafka version to be generated in code by build (instead of in manifest) Key: KAFKA-1901 URL: https://issues.apache.org/jira/browse/KAFKA-1901 Projec

[jira] [Commented] (KAFKA-1693) Issue sending more messages to single Kafka server (Load testing for Kafka transport)

[ https://issues.apache.org/jira/browse/KAFKA-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291487#comment-14291487 ] rajendram kathees commented on KAFKA-1693: -- Thanks Rasmeet. The issue is resolved

[jira] [Resolved] (KAFKA-1693) Issue sending more messages to single Kafka server (Load testing for Kafka transport)

[ https://issues.apache.org/jira/browse/KAFKA-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajendram kathees resolved KAFKA-1693. -- Resolution: Fixed > Issue sending more messages to single Kafka server (Load testing for

[jira] [Commented] (KAFKA-1888) Add a "rolling upgrade" system test

[ https://issues.apache.org/jira/browse/KAFKA-1888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291482#comment-14291482 ] Ashish Kumar Singh commented on KAFKA-1888: --- [~gwenshap] this is indeed an impor

[jira] [Commented] (KAFKA-1867) liveBroker list not updated on a cluster with no topics

[ https://issues.apache.org/jira/browse/KAFKA-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291468#comment-14291468 ] Sriharsha Chintalapani commented on KAFKA-1867: --- Thanks [~nehanarkhede] . Pl

[jira] [Commented] (KAFKA-1867) liveBroker list not updated on a cluster with no topics

[ https://issues.apache.org/jira/browse/KAFKA-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291467#comment-14291467 ] Sriharsha Chintalapani commented on KAFKA-1867: --- Updated reviewboard https:/

Re: Review Request 30007: Patch for KAFKA-1867

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30007/ --- (Updated Jan. 26, 2015, 5:07 a.m.) Review request for kafka. Bugs: KAFKA-1867

[jira] [Updated] (KAFKA-1867) liveBroker list not updated on a cluster with no topics

[ https://issues.apache.org/jira/browse/KAFKA-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1867: -- Attachment: KAFKA-1867_2015-01-25_21:07:47.patch > liveBroker list not updated o

Build failed in Jenkins: Kafka-trunk #381

See Changes: [neha.narkhede] KAFKA-1885 Upgrade junit dependency in core to 4.6 version to allow running individual test methods via gradle command line; reviewed by Neha Narkhede [neha.narkhede] KAFKA-1818 KAFKA-1818 clean up code to mor

[jira] [Commented] (KAFKA-1867) liveBroker list not updated on a cluster with no topics

[ https://issues.apache.org/jira/browse/KAFKA-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291425#comment-14291425 ] Neha Narkhede commented on KAFKA-1867: -- [~sriharsha] I can help you review. Can you p

[jira] [Updated] (KAFKA-1818) Code cleanup in ReplicationUtils including unit test

[ https://issues.apache.org/jira/browse/KAFKA-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1818: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch, [~olander

[jira] [Updated] (KAFKA-1818) Code cleanup in ReplicationUtils including unit test

[ https://issues.apache.org/jira/browse/KAFKA-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1818: - Fix Version/s: 0.8.3 > Code cleanup in ReplicationUtils including unit test >

Build failed in Jenkins: Kafka-trunk #380

See Changes: [neha.narkhede] KAFKA-1109 Need to fix GC log configuration code, not able to override KAFKA_GC_LOG_OPTS; reviewed by Neha Narkhede [neha.narkhede] KAFKA-1883 Fix NullPointerException in RequestSendThread; reviewed by Neha Na

[jira] [Updated] (KAFKA-1885) Allow test methods in "core" to be individually run from outside of the IDE

[ https://issues.apache.org/jira/browse/KAFKA-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1885: - Fix Version/s: 0.8.3 > Allow test methods in "core" to be individually run from outside of the IDE

[jira] [Updated] (KAFKA-1885) Allow test methods in "core" to be individually run from outside of the IDE

[ https://issues.apache.org/jira/browse/KAFKA-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1885: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch. Pushed to

[jira] [Updated] (KAFKA-1885) Allow test methods in "core" to be individually run from outside of the IDE

[ https://issues.apache.org/jira/browse/KAFKA-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1885: - Reviewer: Neha Narkhede > Allow test methods in "core" to be individually run from outside of the

Re: Review Request 30078: Patch for KAFKA-1885

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30078/#review69588 --- Ship it! Ship It! - Neha Narkhede On Jan. 24, 2015, 11:52 a.m.,

[jira] [Commented] (KAFKA-1792) change behavior of --generate to produce assignment config with fair replica distribution and minimal number of reassignments

[ https://issues.apache.org/jira/browse/KAFKA-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291417#comment-14291417 ] Neha Narkhede commented on KAFKA-1792: -- [~Dmitry Pekar] Hope you enjoyed your break :

[jira] [Updated] (KAFKA-1883) NullPointerException in RequestSendThread

[ https://issues.apache.org/jira/browse/KAFKA-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1883: - Fix Version/s: 0.8.3 > NullPointerException in RequestSendThread > ---

[jira] [Updated] (KAFKA-1883) NullPointerException in RequestSendThread

[ https://issues.apache.org/jira/browse/KAFKA-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1883: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch. Pushed to

[jira] [Commented] (KAFKA-1852) OffsetCommitRequest can commit offset on unknown topic

[ https://issues.apache.org/jira/browse/KAFKA-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291407#comment-14291407 ] Neha Narkhede commented on KAFKA-1852: -- [~jjkoshy] would you like to take a look at t

Re: Review Request 30062: Patch for KAFKA-1883

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30062/#review69586 --- Ship it! Ship It! - Neha Narkhede On Jan. 20, 2015, 3:40 a.m., J

[jira] [Updated] (KAFKA-1109) Need to fix GC log configuration code, not able to override KAFKA_GC_LOG_OPTS

[ https://issues.apache.org/jira/browse/KAFKA-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1109: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch. Pushed to

[jira] [Updated] (KAFKA-1109) Need to fix GC log configuration code, not able to override KAFKA_GC_LOG_OPTS

[ https://issues.apache.org/jira/browse/KAFKA-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1109: - Fix Version/s: 0.8.3 > Need to fix GC log configuration code, not able to override KAFKA_GC_LOG_OP

Re: Review Request 30073: Patch for KAFKA-1109

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30073/#review69585 --- Ship it! Ship It! - Neha Narkhede On Jan. 20, 2015, 12:07 p.m.,

[jira] [Closed] (KAFKA-1045) producer zk.connect config

[ https://issues.apache.org/jira/browse/KAFKA-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-1045. > producer zk.connect config > -- > > Key: KAFKA-1045 >

Re: Review Request 30084: Patch for KAFKA-1866

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30084/#review69584 --- Can we add a test for this? If we add more metrics in the future, ho

Re: Review Request 28108: KAFKA-1664: Kafka does not properly parse multiple ZK nodes with non-root chroot

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28108/#review69582 --- Sorry for the late review. Can check this in once you get a chance t

[jira] [Commented] (KAFKA-1861) Publishing kafka-client:test in order to utilize the helper utils in TestUtils

[ https://issues.apache.org/jira/browse/KAFKA-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291369#comment-14291369 ] Neha Narkhede commented on KAFKA-1861: -- [~navina] Can you please see if the above pat

[jira] [Updated] (KAFKA-1867) liveBroker list not updated on a cluster with no topics

[ https://issues.apache.org/jira/browse/KAFKA-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1867: - Reviewer: Neha Narkhede > liveBroker list not updated on a cluster with no topics > --

Re: Review Request 29840: Patch for KAFKA-1818

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29840/#review69580 --- core/src/main/scala/kafka/utils/ReplicationUtils.scala

[jira] [Updated] (KAFKA-1886) SimpleConsumer swallowing ClosedByInterruptException

[ https://issues.apache.org/jira/browse/KAFKA-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1886: - Assignee: Aditya Auradkar (was: Jun Rao) > SimpleConsumer swallowing ClosedByInterruptException >

[jira] [Updated] (KAFKA-1886) SimpleConsumer swallowing ClosedByInterruptException

[ https://issues.apache.org/jira/browse/KAFKA-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1886: - Reviewer: Neha Narkhede > SimpleConsumer swallowing ClosedByInterruptException > -

Re: Review Request 30196: Patch for KAFKA-1886

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30196/#review69579 --- core/src/test/scala/unit/kafka/integration/PrimitiveApiTest.scala <

[jira] [Comment Edited] (KAFKA-1886) SimpleConsumer swallowing ClosedByInterruptException

[ https://issues.apache.org/jira/browse/KAFKA-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284963#comment-14284963 ] Neha Narkhede edited comment on KAFKA-1886 at 1/26/15 1:25 AM: -

[jira] [Commented] (KAFKA-1888) Add a "rolling upgrade" system test

[ https://issues.apache.org/jira/browse/KAFKA-1888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291340#comment-14291340 ] Neha Narkhede commented on KAFKA-1888: -- This is a very useful test. However, I'd reco

[jira] [Updated] (KAFKA-1862) Pass in the Time object into OffsetManager

[ https://issues.apache.org/jira/browse/KAFKA-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1862: - Assignee: Aditya Auradkar > Pass in the Time object into OffsetManager > -

Re: Review Request 29831: Patch for KAFKA-1476

> On Jan. 23, 2015, 4:47 p.m., Neha Narkhede wrote: > > core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala, line 259 > > > > > > => If set along with --delete > > > > I'm not sure if I fully understood

Re: [kafka-clients] Re: [VOTE] 0.8.2.0 Candidate 2 (with the correct links)

+1 (binding) Verified keys, quick start, unit tests. On Sat, Jan 24, 2015 at 4:26 PM, Joe Stein wrote: > That makes sense, thanks! > > On Sat, Jan 24, 2015 at 7:00 PM, Jay Kreps wrote: > > > But I think the flaw in trying to guess what kind of serializer they will > > use is when we get it wron

Re: [KIP-DISCUSSION] Mirror Maker Enhancement

I think there is some value in investigating if we can go back to the simple mirror maker design, as Jay points out. Here you have N threads, each has a consumer and a producer. The reason why we had to move away from that was a combination of the difference in throughput between the consumer and

Re: Cannot stop Kafka server if zookeeper is shutdown first

For a clean shutdown, the broker tries to talk to the controller and also issues reads to zookeeper. Possibly that is where it tries to reconnect to zk. It will help to look at the thread dump. Thanks Neha On Fri, Jan 23, 2015 at 8:53 PM, Jaikiran Pai wrote: > I was just playing around with the

[jira] [Updated] (KAFKA-1722) static analysis code coverage for pci audit needs

[ https://issues.apache.org/jira/browse/KAFKA-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Kumar Singh updated KAFKA-1722: -- Attachment: Sonar's summary report.png > static analysis code coverage for pci audit nee

[jira] [Comment Edited] (KAFKA-1722) static analysis code coverage for pci audit needs

[ https://issues.apache.org/jira/browse/KAFKA-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291268#comment-14291268 ] Ashish Kumar Singh edited comment on KAFKA-1722 at 1/25/15 9:01 PM:

[jira] [Updated] (KAFKA-1722) static analysis code coverage for pci audit needs

[ https://issues.apache.org/jira/browse/KAFKA-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Kumar Singh updated KAFKA-1722: -- Attachment: core coverage.png clients coverage.png Attaching screen shot

[jira] [Commented] (KAFKA-1722) static analysis code coverage for pci audit needs

[ https://issues.apache.org/jira/browse/KAFKA-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291268#comment-14291268 ] Ashish Kumar Singh commented on KAFKA-1722: --- [~joestein] could you take a look a

[jira] [Created] (KAFKA-1900) Add documentation on usage of code coverage in the project and how it works

Ashish Kumar Singh created KAFKA-1900: - Summary: Add documentation on usage of code coverage in the project and how it works Key: KAFKA-1900 URL: https://issues.apache.org/jira/browse/KAFKA-1900 P

[jira] [Created] (KAFKA-1899) Update code coverage report generation once gradle-scoverage starts publishing scoverage report

Ashish Kumar Singh created KAFKA-1899: - Summary: Update code coverage report generation once gradle-scoverage starts publishing scoverage report Key: KAFKA-1899 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Commented] (KAFKA-1722) static analysis code coverage for pci audit needs

[ https://issues.apache.org/jira/browse/KAFKA-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291266#comment-14291266 ] Ashish Kumar Singh commented on KAFKA-1722: --- How to run: ./gradlew sonarRunner -

Re: Review Request 30259: Add static code coverage reporting capability

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30259/ --- (Updated Jan. 25, 2015, 8:47 p.m.) Review request for kafka. Changes ---

[jira] [Updated] (KAFKA-1722) static analysis code coverage for pci audit needs

[ https://issues.apache.org/jira/browse/KAFKA-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Kumar Singh updated KAFKA-1722: -- Attachment: KAFKA-1722.patch > static analysis code coverage for pci audit needs > -

[jira] [Updated] (KAFKA-1722) static analysis code coverage for pci audit needs

[ https://issues.apache.org/jira/browse/KAFKA-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Kumar Singh updated KAFKA-1722: -- Status: Patch Available (was: Open) > static analysis code coverage for pci audit needs

[jira] [Commented] (KAFKA-1722) static analysis code coverage for pci audit needs

[ https://issues.apache.org/jira/browse/KAFKA-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291263#comment-14291263 ] Ashish Kumar Singh commented on KAFKA-1722: --- Created reviewboard https://reviews

Review Request 30259: Add static code coverage reporting capability

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30259/ --- Review request for kafka. Bugs: KAFKA-1722 https://issues.apache.org/jira/b

Re: 0.9 security features and release schedule

hi, On Sun, Jan 25, 2015 at 11:06 AM, Jeff Holoman wrote: > Justin, > > I'd be interested to learn specifically what security features you are > interested in. we are interested in both simple authentication and per-topic authorization. we can get started with simple authentication, but will nee

Re: What to do when file.rename fails?

Hmm, but I don't think tmp gets cleaned while the server is running... The reason for using tmp was because we don't know which directory they will use and we don't want them to have to edit configuration for the simple "out of the box" getting started tutorial. I actually do think that is importa

Re: What to do when file.rename fails?

This feels like another type of symptom from people using /tmp/ for their logs. Perosnally, I would rather use /mnt/data or something and if that doesn't exist on their machine we can exception, or no default and force set it. /*** Joe Stein Founder, Princi

Re: What to do when file.rename fails?

I think you are right, good catch. It could be that this user deleted the files manually, but I wonder if there isn't some way that is a Kafka bug--e.g. if multiple types of retention policies kick in at the same time do we synchronize that properly? -Jay On Sat, Jan 24, 2015 at 9:26 PM, Jaikiran

Re: 0.9 security features and release schedule

Justin, I'd be interested to learn specifically what security features you are interested in. There is a doc on the wiki here https://cwiki.apache.org/confluence/display/KAFKA/Security As well as the Umbrella JIRA Here: https://issues.apache.org/jira/browse/KAFKA-1682 Most security-related JIRA

[jira] [Updated] (KAFKA-1810) Add IP Filtering / Whitelists-Blacklists

[ https://issues.apache.org/jira/browse/KAFKA-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Holoman updated KAFKA-1810: Component/s: security > Add IP Filtering / Whitelists-Blacklists >

0.9 security features and release schedule

Hi, We're assessing Kafka for use at Acquia. We run tens of thousands of customer websites and many internal applications on ~9k AWS EC2 instances. We're currently weighing the pros and cons of starting with 0.82 plus custom security, or waiting until the security features land in 0.9. How likel