[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067380#comment-14067380 ] Jun Rao commented on KAFKA-1414: Oh, I was thinking about the local var referenced in load

[jira] [Commented] (KAFKA-1070) Auto-assign node id

2014-07-18 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067274#comment-14067274 ] Sriharsha Chintalapani commented on KAFKA-1070: --- Thanks [~jkreps] > Auto-as

[jira] [Updated] (KAFKA-1070) Auto-assign node id

2014-07-18 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1070: -- Attachment: KAFKA-1070.patch > Auto-assign node id > --- > >

[jira] [Commented] (KAFKA-1070) Auto-assign node id

2014-07-18 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067273#comment-14067273 ] Sriharsha Chintalapani commented on KAFKA-1070: --- Created reviewboard https:/

Review Request 23702: Patch for KAFKA-1070

2014-07-18 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23702/ --- Review request for kafka. Bugs: KAFKA-1070 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-1430) Purgatory redesign

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067182#comment-14067182 ] Guozhang Wang commented on KAFKA-1430: -- Created reviewboard https://reviews.apache.or

[jira] [Updated] (KAFKA-1430) Purgatory redesign

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1430: - Attachment: KAFKA-1430.patch > Purgatory redesign > -- > > Key: K

Review Request 23699: Fix KAFKA-1430

2014-07-18 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23699/ --- Review request for kafka. Bugs: KAFKA-1430 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067074#comment-14067074 ] Jay Kreps commented on KAFKA-1535: -- [~nmarasoi] Totally up to you. > return all live bro

[jira] [Commented] (KAFKA-328) Write unit test for kafka server startup and shutdown API

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067071#comment-14067071 ] BalajiSeshadri commented on KAFKA-328: -- Is this the kind of test you are expecting.

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-18 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067065#comment-14067065 ] Anton Karamanov commented on KAFKA-1414: But that would actually require changing

Re: Improving the Kafka client ecosystem

2014-07-18 Thread Jay Kreps
Basically my thought with getting a separate mailing list was to have a place specifically to discuss issues around clients. I don't see a lot of discussion about them on the main list. I thought perhaps this was because people don't like to ask questions which are about adjacent projects/code base

Re: Review Request 23655: Patch for KAFKA-687

2014-07-18 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23655/ --- (Updated July 18, 2014, 10:57 p.m.) Review request for kafka. Bugs: KAFKA-687

[jira] [Updated] (KAFKA-687) Rebalance algorithm should consider partitions from all topics

2014-07-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-687: - Attachment: KAFKA-687_2014-07-18_15:55:15.patch > Rebalance algorithm should consider partitions from all

[jira] [Commented] (KAFKA-687) Rebalance algorithm should consider partitions from all topics

2014-07-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067051#comment-14067051 ] Joel Koshy commented on KAFKA-687: -- Updated reviewboard https://reviews.apache.org/r/23655

Re: Review Request 23655: Patch for KAFKA-687

2014-07-18 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23655/ --- (Updated July 18, 2014, 10:55 p.m.) Review request for kafka. Summary (update

Re: Improving the Kafka client ecosystem

2014-07-18 Thread Jun Rao
Another important part of eco-system could be around the adaptors of getting data from other systems into Kafka and vice versa. So, for the ingestion part, this can include things like getting data from mysql, syslog, apache server log, etc. For the egress part, this can include putting Kafka data

[jira] [Commented] (KAFKA-1533) transient unit test failure in ProducerFailureHandlingTest

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067028#comment-14067028 ] Guozhang Wang commented on KAFKA-1533: -- Created reviewboard https://reviews.apache.or

Review Request 23697: Fix KAFKA-1533: Address Jun and Neha's comments

2014-07-18 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23697/ --- Review request for kafka. Bugs: KAFKA-1533 https://issues.apache.org/jira/b

[jira] [Updated] (KAFKA-1533) transient unit test failure in ProducerFailureHandlingTest

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1533: - Attachment: KAFKA-1533.patch > transient unit test failure in ProducerFailureHandlingTest > -

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067014#comment-14067014 ] Jun Rao commented on KAFKA-1414: I can't think of better names. So that sounds good. > Sp

Re: Review Request 23593: Fix KAFKA-1533: Address Jun's comments

2014-07-18 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23593/#review48162 --- Neha also had a comment in the previous RB. clients/src/main/java/

Re: Review Request 23442: Patch for KAFKA-1330

2014-07-18 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23442/#review48139 --- Ran unit tests twice. Saw the following failure twice. kafka.api.I

Improving the Kafka client ecosystem

2014-07-18 Thread Jay Kreps
A question was asked in another thread about what was an effective way to contribute to the Kafka project for people who weren't very enthusiastic about writing Java/Scala code. I wanted to kind of advocate for an area I think is really important and not as good as it could be--the client ecosyste

[jira] [Updated] (KAFKA-1550) Patch review tool should use git format-patch to generate patch

2014-07-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1550: Attachment: KAFKA-1550.patch > Patch review tool should use git format-patch to generate patch > --

[jira] [Commented] (KAFKA-1550) Patch review tool should use git format-patch to generate patch

2014-07-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066871#comment-14066871 ] Dong Lin commented on KAFKA-1550: - Created reviewboard https://reviews.apache.org/r/23692/

Review Request 23692: Patch for KAFKA-1550

2014-07-18 Thread Dong Lin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23692/ --- Review request for kafka. Bugs: KAFKA-1550 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-18 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066847#comment-14066847 ] Anton Karamanov commented on KAFKA-1414: Thanks for the review. 40.1. Maybe it wo

[jira] [Updated] (KAFKA-1550) Patch review tool should use git format-patch to generate patch

2014-07-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1550: Description: 1) kafka-patch-review.py uses git-diff to generate patch for jira ticket. The resulting patch

[jira] [Updated] (KAFKA-1550) Patch review tool should use git format-patch to generate patch

2014-07-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1550: Description: 1) kafka-patch-review.py uses git-diff to generate patch for jira ticket. The resulting patch

[jira] [Created] (KAFKA-1550) Patch review tool should use git format-patch to generate patch

2014-07-18 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-1550: --- Summary: Patch review tool should use git format-patch to generate patch Key: KAFKA-1550 URL: https://issues.apache.org/jira/browse/KAFKA-1550 Project: Kafka Issue Ty

[jira] [Comment Edited] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066791#comment-14066791 ] nicu marasoiu edited comment on KAFKA-1535 at 7/18/14 7:50 PM: -

[jira] [Commented] (KAFKA-1510) Force offset commits at a minimum interval when migrating consumer offsets from zookeeper to kafka

2014-07-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066792#comment-14066792 ] Joel Koshy commented on KAFKA-1510: --- I think it should be sufficient to force commit onl

[jira] [Commented] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066791#comment-14066791 ] nicu marasoiu commented on KAFKA-1535: -- created KAFKA-1549 with Major priority. I als

[jira] [Assigned] (KAFKA-1510) Force offset commits at a minimum interval when migrating consumer offsets from zookeeper to kafka

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nicu marasoiu reassigned KAFKA-1510: Assignee: nicu marasoiu > Force offset commits at a minimum interval when migrating consume

[jira] [Commented] (KAFKA-1549) dead brokers coming in the TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066784#comment-14066784 ] nicu marasoiu commented on KAFKA-1549: -- esepntially i will replace the list/map of br

[jira] [Updated] (KAFKA-1549) dead brokers coming in the TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nicu marasoiu updated KAFKA-1549: - Description: JunRao confirming my observation that brokers are only added to the metadataCache, n

[jira] [Updated] (KAFKA-1549) dead brokers coming in the TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nicu marasoiu updated KAFKA-1549: - Affects Version/s: 0.8.2 > dead brokers coming in the TopicMetadataResponse > ---

[jira] [Updated] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri updated KAFKA-1476: -- Status: In Progress (was: Patch Available) > Get a list of consumer groups > -

[jira] [Updated] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri updated KAFKA-1476: -- Attachment: KAFKA-1476-RENAME.patch > Get a list of consumer groups > -

[jira] [Updated] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri updated KAFKA-1476: -- Assignee: BalajiSeshadri Status: Patch Available (was: Open) Attaching updated patch >

[jira] [Updated] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri updated KAFKA-1476: -- Status: Patch Available (was: In Progress) > Get a list of consumer groups > -

[jira] [Updated] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri updated KAFKA-1476: -- Status: Open (was: Patch Available) > Get a list of consumer groups >

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066776#comment-14066776 ] BalajiSeshadri commented on KAFKA-1476: --- Please find patch attached after renaming t

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Balaji Seshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066720#comment-14066720 ] Balaji Seshadri commented on KAFKA-1476: Which shell script should i change,i wrot

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Balaji Seshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066698#comment-14066698 ] Balaji Seshadri commented on KAFKA-1476: ~jay.kreps > Get a list of consumer gr

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066699#comment-14066699 ] Guozhang Wang commented on KAFKA-1476: -- You are already ahead of us, since the coordi

[jira] [Issue Comment Deleted] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Balaji Seshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Seshadri updated KAFKA-1476: --- Comment: was deleted (was: ~jay.kreps ) > Get a list of consumer groups > -

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Balaji Seshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066695#comment-14066695 ] Balaji Seshadri commented on KAFKA-1476: I have completed 1 and 2,will work on 3/4

Re: JIRA problem

2014-07-18 Thread Joe Stein
I have been assigning people on confluence (they granted us access at that time after some back and forth) we already have permission to-do that no reason to talk to INFRA. Everyone in the PMC should have access. /*** Joe Stein Founder, Principal Consulta

Re: JIRA problem

2014-07-18 Thread Guozhang Wang
I once noticed Samza also had a similar problem and Jacob resolved it by talking to the Apache people. We can probably ask him how he gets it done. On Fri, Jul 18, 2014 at 10:36 AM, Joe Stein wrote: > Jay, I agree with you. > > This goes back to the spam fiasco that occurred on confluence and t

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066613#comment-14066613 ] Guozhang Wang commented on KAFKA-1476: -- 1. List groups: return the list of group ids.

Re: JIRA problem

2014-07-18 Thread Jay Kreps
Joe--that sounds great, let's do that! So I guess we should put something in the wiki about how to get added to that group? Jarek--thanks for the summary, that is very helpful. I will follow-up with the infra people on letting people assign JIRAs. -jay On Fri, Jul 18, 2014 at 10:36 AM, Joe Stei

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066583#comment-14066583 ] Jay Kreps commented on KAFKA-1476: -- Cool, so [~balaji.seshadri] would you be willing to r

Re: JIRA problem

2014-07-18 Thread Joe Stein
Jay, I agree with you. This goes back to the spam fiasco that occurred on confluence and the pendulum swinging because of it. Re-reading that email there doesn't seem anything specific requiring us to have them sign the ICLA but it looks like that is a requirement if we wanted INFRA to assign the

Re: JIRA problem

2014-07-18 Thread Jarek Jarcec Cecho
I do see separate concerns here, so let me describe how we’re addressing them in other projects where I’m involved. It doesn’t mean that Kafka need to follow them, just sharing my experience. 1) Submitting a patch to JIRA No paper work required, all legalities are resolved implicitly by the fact

Re: JIRA problem

2014-07-18 Thread Jay Kreps
I think having people fax in permission slips to edit the wiki or get bugs assigned to them is a bit hostile to potential contributors. Is this a legal Apache restriction that we have to abide by or just the way our permissions defaulted? Can we change this? Would people be opposed to changing it?

[jira] [Commented] (KAFKA-1509) Restart of destination broker after unreplicated partition move leaves partitions without leader

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066567#comment-14066567 ] Guozhang Wang commented on KAFKA-1509: -- Yes this is still a valid issue, but could pr

Re: [DISCUSS] Kafka Security Specific Features

2014-07-18 Thread Pramod Deshmukh
Thanks Joe, I don't see any Out of memory error. Now I get exception when Producer fetches metadata for a topic Here is how I created the topic and run producer pdeshmukh$ bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic secureTopic Created top

[jira] [Created] (KAFKA-1549) dead brokers coming in the TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
nicu marasoiu created KAFKA-1549: Summary: dead brokers coming in the TopicMetadataResponse Key: KAFKA-1549 URL: https://issues.apache.org/jira/browse/KAFKA-1549 Project: Kafka Issue Type: Bu

[jira] [Commented] (KAFKA-1549) dead brokers coming in the TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066548#comment-14066548 ] nicu marasoiu commented on KAFKA-1549: -- test if i receive mails on this jira task >

[jira] [Assigned] (KAFKA-1282) Disconnect idle socket connection in Selector

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nicu marasoiu reassigned KAFKA-1282: Assignee: nicu marasoiu > Disconnect idle socket connection in Selector > -

[jira] [Commented] (KAFKA-1180) WhiteList topic filter gets a NullPointerException on complex Regex

2014-07-18 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066540#comment-14066540 ] Joe Stein commented on KAFKA-1180: -- [~nehanarkhede] I was going to add to the WhiteList &

[jira] [Commented] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066538#comment-14066538 ] nicu marasoiu commented on KAFKA-1535: -- Sure do want:) Yes, that was my suggestion as

Re: Review Request 23516: Patch for KAFKA-1462

2014-07-18 Thread Jun Rao
> On July 17, 2014, 9:52 p.m., Guozhang Wang wrote: > > I am not sure why we need to remove correlationId from the > > ReuqestOrResponse in order to do ser/deser. Shouldn't we just add > > correlation_id to the AbstractRequestResponse java class? This is just to make reusing the client request

[jira] [Commented] (KAFKA-1510) Force offset commits at a minimum interval when migrating consumer offsets from zookeeper to kafka

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066532#comment-14066532 ] Guozhang Wang commented on KAFKA-1510: -- Hi Nicolae, Thanks for taking this ticket. Y

Re: JIRA problem

2014-07-18 Thread Jun Rao
I am not sure if an ICLA is required for contributing patches. Requiring that may make it harder for people who want to contribute. Currently, only Kafka PMC members can change the contributors list. Thanks, Jun On Fri, Jul 18, 2014 at 9:45 AM, Joe Stein wrote: > Shouldn't we make sure that

Re: JIRA problem

2014-07-18 Thread Jarek Jarcec Cecho
To my best knowledge ICLA is required only for committers - people that do have commit bit on ASF repositories. Contributors can’t commit their patch themselves and hence they have to attach their patch to JIRA where they implicitly agree with all the legal stuff. There is some license agreemen

Re: JIRA problem

2014-07-18 Thread Joe Stein
Shouldn't we make sure that the people in the contributor group have signed and sent in their ICLA http://www.apache.org/licenses/icla.txt much like we do for confluence? This helps to control also that all contributors have signed an ICLA too. /*** Joe St

Re: JIRA problem

2014-07-18 Thread Jarek Jarcec Cecho
I would assume that you will have to go to this page: https://issues.apache.org/jira/plugins/servlet/project-config/KAFKA/roles I don’t have access there, I’ve just replaced project name SQOOP with KAFKA :-) Jarcec On Jul 18, 2014, at 9:35 AM, Jarek Jarcec Cecho wrote: > You have to add those

[jira] [Assigned] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-1535: -- Assignee: nicu marasoiu (was: Jay Kreps) Nicu, Yes, your observation is correct. The way that we upda

Re: JIRA problem

2014-07-18 Thread Jarek Jarcec Cecho
You have to add those people as a contributors in JIRA project administration. Click on “roles” in the KAFKA project administration and find field “contributors”. Jarcec On Jul 18, 2014, at 9:32 AM, Jay Kreps wrote: > I can't seem to assign JIRAs to anyone but a few committer people. > Does a

JIRA problem

2014-07-18 Thread Jay Kreps
I can't seem to assign JIRAs to anyone but a few committer people. Does anyone know what causes this or how to fix it? Is this happening to anyone else? -Jay

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Todd Palino (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066488#comment-14066488 ] Todd Palino commented on KAFKA-1476: I tend to agree, ~jkreps. We currently have kafka

[jira] [Commented] (KAFKA-1282) Disconnect idle socket connection in Selector

2014-07-18 Thread Nicolae Marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066481#comment-14066481 ] Nicolae Marasoiu commented on KAFKA-1282: - Beautiful, I can't wait to work this ou

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066477#comment-14066477 ] Jun Rao commented on KAFKA-1414: Thanks for patch v4. Some more comments. 40. LogManager:

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066471#comment-14066471 ] Jay Kreps commented on KAFKA-1476: -- This looks good to me. One thing we should think abo

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066467#comment-14066467 ] Neha Narkhede commented on KAFKA-1476: -- Thanks for the patch, [~balaji.sesha...@dish.

Re: [DISCUSS] Kafka Security Specific Features

2014-07-18 Thread Joe Stein
Hi Pramod, Can you increase KAFKA_HEAP_OPTS to lets say -Xmx1G in the kafka-console-producer.sh to see if that gets you further along please in your testing? Thanks! /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://

[jira] [Commented] (KAFKA-1282) Disconnect idle socket connection in Selector

2014-07-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066461#comment-14066461 ] Jay Kreps commented on KAFKA-1282: -- The goal is just to reduce server connection count. I

[jira] [Commented] (KAFKA-1451) Broker stuck due to leader election race

2014-07-18 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066456#comment-14066456 ] Neha Narkhede commented on KAFKA-1451: -- Just checking the existence is not enough sin

[jira] [Commented] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2014-07-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066440#comment-14066440 ] Jay Kreps commented on KAFKA-1150: -- Yeah, [~thecoop1984], can you verify that the patch o

[jira] [Commented] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066439#comment-14066439 ] Jay Kreps commented on KAFKA-1535: -- To date we have not really used pull requests. Apache

[jira] [Commented] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066435#comment-14066435 ] Guozhang Wang commented on KAFKA-1150: -- Simon, I am currently working on KAFKA-1430,

Re: KAFKA-1150

2014-07-18 Thread Guozhang Wang
Hi Simon, Just commented on the ticket. Guozhang On Fri, Jul 18, 2014 at 4:56 AM, Simon Cooper < simon.coo...@featurespace.co.uk> wrote: > There's been no recent movement on KAFKA-1150. We’re significantly > affected by this bug, trying to achieve small-millisecond transfer > latencies on a re

[jira] [Updated] (KAFKA-1536) Change the status of the JIRA to "Patch Available" in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1536: --- Attachment: (was: KAFKA-1536_2014-07-18_20:36:29.patch) > Change the status of the JIRA t

[jira] [Updated] (KAFKA-1536) Change the status of the JIRA to "Patch Available" in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1536: --- Assignee: Manikumar Reddy (was: Neha Narkhede) Status: Open (was: Patch Available) fo

[jira] [Updated] (KAFKA-1536) Change the status of the JIRA to "Patch Available" in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1536: --- Status: Patch Available (was: Open) > Change the status of the JIRA to "Patch Available" in

Re: Review Request 23440: addressing reviewer comments

2014-07-18 Thread Manikumar Reddy O
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23440/ --- (Updated July 18, 2014, 3:13 p.m.) Review request for kafka. Summary (updated

[jira] [Updated] (KAFKA-1536) Change the status of the JIRA to "Patch Available" in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1536: --- Attachment: KAFKA-1536_2014-07-18_20:41:40.patch > Change the status of the JIRA to "Patch Av

[jira] [Commented] (KAFKA-1536) Change the status of the JIRA to "Patch Available" in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066427#comment-14066427 ] Manikumar Reddy commented on KAFKA-1536: Updated reviewboard https://reviews.apach

[jira] [Updated] (KAFKA-1536) Change the status of the JIRA to "Patch Available" in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1536: --- Attachment: KAFKA-1536_2014-07-18_20:36:29.patch > Change the status of the JIRA to "Patch Av

[jira] [Updated] (KAFKA-1536) Change the status of the JIRA to "Patch Available" in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1536: --- Attachment: (was: KAFKA-1536.patch) > Change the status of the JIRA to "Patch Available"

[jira] [Commented] (KAFKA-328) Write unit test for kafka server startup and shutdown API

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066423#comment-14066423 ] BalajiSeshadri commented on KAFKA-328: -- Sure will do. Can you guys please verify my pa

[jira] [Commented] (KAFKA-1536) Change the status of the JIRA to "Patch Available" in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066424#comment-14066424 ] Manikumar Reddy commented on KAFKA-1536: Updated reviewboard https://reviews.apach

Re: Review Request 23440: Patch for KAFKA-1536; addressing reviewer comments

2014-07-18 Thread Manikumar Reddy O
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23440/ --- (Updated July 18, 2014, 3:08 p.m.) Review request for kafka. Summary (updated

[jira] [Commented] (KAFKA-1509) Restart of destination broker after unreplicated partition move leaves partitions without leader

2014-07-18 Thread Albert Strasheim (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066411#comment-14066411 ] Albert Strasheim commented on KAFKA-1509: - [~nmarasoiu] Yes, I think a fix is stil

Re: [DISCUSS] Kafka Security Specific Features

2014-07-18 Thread Pramod Deshmukh
Hello Raja/Joe, When I turn on security, i still get out of memory error on producer. Is this something to do with keys? Is there any other way I can connect to broker? *producer log* [2014-07-17 15:38:14,186] ERROR OOME with size 352518400 (kafka.network. BoundedByteBufferReceive) java.lang.OutOf

[jira] [Commented] (KAFKA-1509) Restart of destination broker after unreplicated partition move leaves partitions without leader

2014-07-18 Thread Nicolae Marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066319#comment-14066319 ] Nicolae Marasoiu commented on KAFKA-1509: - Is a fix still needed for this, do you

[jira] [Commented] (KAFKA-1282) Disconnect idle socket connection in Selector

2014-07-18 Thread Nicolae Marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066315#comment-14066315 ] Nicolae Marasoiu commented on KAFKA-1282: - Right, the limitation is more critical

  1   2   >