Re: Kafka security

2013-09-17 Thread Neha Narkhede
At this point, the wiki is in a preliminary stage. Feel free to comment on the wiki with any ideas that you may have on Kafka Security. If it helps, we can take the discussion to a JIRA. Thanks, Neha On Mon, Sep 16, 2013 at 1:51 AM, Joe Brown wrote: > https://cwiki.apache.org/confluence/displa

Re: Random Partitioning Issue

2013-09-17 Thread Joel Koshy
I agree that minimizing the number of producer connections (while being a good thing) is really required in very large production deployments, and the net-effect of the existing change is counter-intuitive to users who expect an immediate even distribution across _all_ partitions of the topic. How

Re: [VOTE] Bylaws!

2013-09-17 Thread Jay Kreps
Tally is 6 for and 0 against, so those are now the Kafka bylaws. :-) -Jay On Mon, Sep 16, 2013 at 4:09 PM, Prashanth Menon wrote: > +1 > > > On Fri, Sep 13, 2013 at 7:36 PM, Jun Rao wrote: > > > +1 > > > > Jun > > > > > > On Fri, Sep 13, 2013 at 9:53 AM, Jay Kreps wrote: > > > > > It was poi

Re: Review Request 14041: Patch for KAFKA-1030

2013-09-17 Thread Swapnil Ghike
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14041/#review26179 --- Ship it! Ship It! - Swapnil Ghike On Sept. 17, 2013, 6 p.m., Guo

Re: Review Request 14041: Patch for KAFKA-1030

2013-09-17 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14041/#review26180 --- Ship it! - Neha Narkhede On Sept. 17, 2013, 6 p.m., Guozhang Wang

Re: Kafka security

2013-09-17 Thread Jay Kreps
Yeah, it would be great to get help. Right now we are basically just fleshing out requirements. We don't have a concrete date for when anyone would start work but we've done some prototyping on the auth front, basically just to understand Kerberos and SASL. -Jay On Tue, Sep 17, 2013 at 9:08 AM,

[jira] [Commented] (KAFKA-1056) Evenly Distribute Intervals in OffsetIndex

2013-09-17 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13769664#comment-13769664 ] Jay Kreps commented on KAFKA-1056: -- Agreed. This becomes a problem in the case where prod

Re: Review Request 14041: Patch for KAFKA-1030

2013-09-17 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14041/ --- (Updated Sept. 17, 2013, 6 p.m.) Review request for kafka. Summary (updated)

[jira] [Updated] (KAFKA-1030) Addition of partitions requires bouncing all the consumers of that topic

2013-09-17 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1030: - Attachment: KAFKA-1030-v1.patch > Addition of partitions requires bouncing all the consumers

[jira] [Commented] (KAFKA-1030) Addition of partitions requires bouncing all the consumers of that topic

2013-09-17 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13769744#comment-13769744 ] Guozhang Wang commented on KAFKA-1030: -- Updated reviewboard https://reviews.apache.or

Re: Random Partitioning Issue

2013-09-17 Thread Jay Kreps
I would be in favor of that. I agree this is better than 0.7. -Jay On Tue, Sep 17, 2013 at 10:19 AM, Joel Koshy wrote: > I agree that minimizing the number of producer connections (while > being a good thing) is really required in very large production > deployments, and the net-effect of the

[jira] [Commented] (KAFKA-1030) Addition of partitions requires bouncing all the consumers of that topic

2013-09-17 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13769879#comment-13769879 ] Guozhang Wang commented on KAFKA-1030: -- Here are the performance testing results: Se

Re: Review Request 14041: Patch for KAFKA-1030

2013-09-17 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14041/#review26183 --- Ship it! Ship It! - Neha Narkhede On Sept. 17, 2013, 6 p.m., Guo

[jira] [Commented] (KAFKA-1030) Addition of partitions requires bouncing all the consumers of that topic

2013-09-17 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13769884#comment-13769884 ] Swapnil Ghike commented on KAFKA-1030: -- +1 that Guozhang, thanks for running the test

[jira] [Commented] (KAFKA-1046) Added support for Scala 2.10 builds while maintaining compatibility with 2.8.x

2013-09-17 Thread Andrew Otto (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13769853#comment-13769853 ] Andrew Otto commented on KAFKA-1046: Hm, I seem to be getting the same compilation err

RE: [jira] [Updated] (KAFKA-1046) Added support for Scala 2.10 builds while maintaining compatibility with 2.8.x

2013-09-17 Thread Yu, Libo
Hi team, Is it safe to apply the 0.8 patch to 0.8 beta1? Regards, Libo -Original Message- From: Joe Stein [mailto:crypt...@gmail.com] Sent: Friday, September 13, 2013 4:10 PM To: dev@kafka.apache.org; us...@kafka.apache.org Subject: Re: [jira] [Updated] (KAFKA-1046) Added support for S

[jira] [Commented] (KAFKA-1030) Addition of partitions requires bouncing all the consumers of that topic

2013-09-17 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13769994#comment-13769994 ] Neha Narkhede commented on KAFKA-1030: -- Thanks for the updated patch and the performa

[jira] [Resolved] (KAFKA-1030) Addition of partitions requires bouncing all the consumers of that topic

2013-09-17 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede resolved KAFKA-1030. -- Resolution: Fixed Checked in the latest patch to 0.8 > Addition of partitions

Review Request 14184: Draft patch for KAFKA-1049

2013-09-17 Thread joel koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14184/ --- Review request for kafka. Bugs: KAFKA-1049 https://issues.apache.org/jira/b

[jira] [Created] (KAFKA-1057) Trim whitespaces from user specified configs

2013-09-17 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-1057: Summary: Trim whitespaces from user specified configs Key: KAFKA-1057 URL: https://issues.apache.org/jira/browse/KAFKA-1057 Project: Kafka Issue Type: Bug

Review Request 14188: Draft patch for KAFKA-1049

2013-09-17 Thread joel koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14188/ --- Review request for kafka. Bugs: KAFKA-1049 https://issues.apache.org/jira/b

[jira] [Updated] (KAFKA-1049) Encoder implementations are required to provide an undocumented constructor.

2013-09-17 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1049: -- Attachment: KAFKA-1049.patch > Encoder implementations are required to provide an undocumented cons

[jira] [Commented] (KAFKA-1049) Encoder implementations are required to provide an undocumented constructor.

2013-09-17 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13770182#comment-13770182 ] Joel Koshy commented on KAFKA-1049: --- Created reviewboard https://reviews.apache.org/r/14

Re: Review Request 14188: Draft patch for KAFKA-1049

2013-09-17 Thread joel koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14188/#review26193 --- Mainly wanted to try out the patch review tool. This draft patch doe

[jira] [Commented] (KAFKA-1053) Kafka patch review tool

2013-09-17 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13770270#comment-13770270 ] Joel Koshy commented on KAFKA-1053: --- Nice - I tried this on KAFKA-1049 (as a test - that

[jira] [Work started] (KAFKA-1053) Kafka patch review tool

2013-09-17 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-1053 started by Neha Narkhede. > Kafka patch review tool > --- > > Key: KAFKA-1053 > URL: https://issues

[jira] [Updated] (KAFKA-1053) Kafka patch review tool

2013-09-17 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1053: - Status: Patch Available (was: In Progress) > Kafka patch review tool > -

[jira] [Closed] (KAFKA-1053) Kafka patch review tool

2013-09-17 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-1053. > Kafka patch review tool > --- > > Key: KAFKA-1053 >

[jira] [Updated] (KAFKA-1053) Kafka patch review tool

2013-09-17 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1053: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the reviews. Joel

[jira] [Created] (KAFKA-1058) Change the patch review tool to use the reviewboard python client

2013-09-17 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-1058: Summary: Change the patch review tool to use the reviewboard python client Key: KAFKA-1058 URL: https://issues.apache.org/jira/browse/KAFKA-1058 Project: Kafka

[jira] [Comment Edited] (KAFKA-1053) Kafka patch review tool

2013-09-17 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13770396#comment-13770396 ] Neha Narkhede edited comment on KAFKA-1053 at 9/18/13 3:59 AM: -

[jira] [Assigned] (KAFKA-1057) Trim whitespaces from user specified configs

2013-09-17 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede reassigned KAFKA-1057: Assignee: Neha Narkhede > Trim whitespaces from user specified configs > --