[jira] [Commented] (KAFKA-1227) Code dump of new producer

2014-01-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880752#comment-13880752 ] Jay Kreps commented on KAFKA-1227: -- Hey Guozhang, thanks for the detailed stylistic quest

[jira] [Commented] (KAFKA-1227) Code dump of new producer

2014-01-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880717#comment-13880717 ] Jay Kreps commented on KAFKA-1227: -- Hey Jun, quick responses. I'll try to get a patch up

[jira] [Comment Edited] (KAFKA-1227) Code dump of new producer

2014-01-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880717#comment-13880717 ] Jay Kreps edited comment on KAFKA-1227 at 1/24/14 4:54 AM: --- Hey

Re: producer rewrite

2014-01-23 Thread Neha Narkhede
There is a link to the reviewboard url on the JIRAmentioned above. That will take you to the patch. On Thu, Jan 23, 2014 at 4:49 PM, S Ahmed wrote: > Sorry I'm new to o/s, how can I look at this patch? > > Would it be mirrored here? https://gith

Re: producer rewrite

2014-01-23 Thread S Ahmed
Sorry I'm new to o/s, how can I look at this patch? Would it be mirrored here? https://github.com/apache/kafka On Thu, Jan 23, 2014 at 3:56 PM, Jay Kreps wrote: > Cool, I've uploaded a patch and rb here: > https://issues.apache.org/jira/browse/KAFKA-1227 > > -Jay > > > On Thu, Jan 23, 2014 at

Re: Review Request 17006: Keep track of local pid and kill it on stopping all entities as discussed with John

2014-01-23 Thread John Fung
> On Jan. 23, 2014, 5:51 p.m., John Fung wrote: > > There will be only 1 producer_performance running per entity_id. Therefore, > > entity_id can be used as a key in the dictionary to keep track of multiple > > running producer_performance threads: > > > > +os.tcaseEnv.producerHostParentPi

[jira] [Commented] (KAFKA-1227) Code dump of new producer

2014-01-23 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880519#comment-13880519 ] Guozhang Wang commented on KAFKA-1227: -- Some more comments: --- General 1. How to w

[jira] [Commented] (KAFKA-1227) Code dump of new producer

2014-01-23 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880474#comment-13880474 ] Jun Rao commented on KAFKA-1227: I made a pass of the producer client code. The following

[jira] [Commented] (KAFKA-1212) System test exception handling does not stop background producer threads

2014-01-23 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880370#comment-13880370 ] John Fung commented on KAFKA-1212: -- Commented in the rb. thanks. > System test exception

Re: producer rewrite

2014-01-23 Thread Jay Kreps
Cool, I've uploaded a patch and rb here: https://issues.apache.org/jira/browse/KAFKA-1227 -Jay On Thu, Jan 23, 2014 at 12:00 PM, Joe Stein wrote: > awesome! +1 for checking this in as is as you suggest > > /*** > Joe Stein > Founder, Principal Consulta

[jira] [Updated] (KAFKA-1227) Code dump of new producer

2014-01-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1227: - Attachment: KAFKA-1227.patch > Code dump of new producer > - > >

[jira] [Commented] (KAFKA-1227) Code dump of new producer

2014-01-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880343#comment-13880343 ] Jay Kreps commented on KAFKA-1227: -- Created reviewboard https://reviews.apache.org/r/1726

Review Request 17263: New producer for Kafka.

2014-01-23 Thread Jay Kreps
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17263/ --- Review request for kafka. Bugs: KAFKA-1227 https://issues.apache.org/jira/b

Review Request 17261: New producer for Kafka.

2014-01-23 Thread Jay Kreps
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17261/ --- Review request for kafka. Bugs: KAFKA-1227 https://issues.apache.org/jira/b

[jira] [Created] (KAFKA-1227) Code dump of new producer

2014-01-23 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1227: Summary: Code dump of new producer Key: KAFKA-1227 URL: https://issues.apache.org/jira/browse/KAFKA-1227 Project: Kafka Issue Type: New Feature Reporter:

Re: producer rewrite

2014-01-23 Thread Joe Stein
awesome! +1 for checking this in as is as you suggest /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop ***

Re: producer rewrite

2014-01-23 Thread Jun Rao
This approach sounds reasonable to me. Since the new code will be not be used in the current kafka jar, we can still release 0.8.1 off trunk when it's ready. Thanks, Jun On Thu, Jan 23, 2014 at 10:23 AM, Jay Kreps wrote: > Hey all, > > I have been working on a rewrite of the producer as descr

Re: producer rewrite

2014-01-23 Thread Neha Narkhede
+1 for checking this in as is. For a from-scratch rewrite like this, I prefer to do incremental reviews on a standalone subproject until it is complete and stable to be merged into the main codebase. Looking forward to the patch! Thanks, Neha On Thu, Jan 23, 2014 at 10:23 AM, Jay Kreps wrote:

Re: Review Request 17006: Keep track of local pid and kill it on stopping all entities as discussed with John

2014-01-23 Thread Guozhang Wang
> On Jan. 23, 2014, 5:51 p.m., John Fung wrote: > > There will be only 1 producer_performance running per entity_id. Therefore, > > entity_id can be used as a key in the dictionary to keep track of multiple > > running producer_performance threads: > > > > +os.tcaseEnv.producerHostParentPi

Simple Auth and Auth

2014-01-23 Thread Joe Brown
Hi All I’ve been looking at the wiki proposal to add Auth and Auth to kafka https://cwiki.apache.org/confluence/display/KAFKA/Security In the meantime I’ve had a recent immediate requirement to implement something similar - my solution is detailed below - fairly quick and dirty but achieved t

[jira] Subscription: outstanding kafka patches

2014-01-23 Thread jira
Issue Subscription Filter: outstanding kafka patches (84 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-1215 Rack-Aware replica assignment option https://issues.apache.org/jira/browse/KAFKA-1215 KAFKA-1214 Support arguments to z

producer rewrite

2014-01-23 Thread Jay Kreps
Hey all, I have been working on a rewrite of the producer as described in the wiki below and discussed in a few previous threads: https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite My code is still has some bugs and is a bit rough in parts, but it functions in the basic cases. I did

Re: Review Request 17248: Patch for KAFKA-1226

2014-01-23 Thread Joris Van Remoortere
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17248/ --- (Updated Jan. 23, 2014, 6:17 p.m.) Review request for kafka. Bugs: KAFKA-1226

Review Request 17248: Patch for KAFKA-1226

2014-01-23 Thread Joris Van Remoortere
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17248/ --- Review request for kafka. Summary (updated) - Patch for KAFKA-

[jira] [Created] (KAFKA-1226) Rack-Aware replica assignment option

2014-01-23 Thread Joris Van Remoortere (JIRA)
Joris Van Remoortere created KAFKA-1226: --- Summary: Rack-Aware replica assignment option Key: KAFKA-1226 URL: https://issues.apache.org/jira/browse/KAFKA-1226 Project: Kafka Issue Type:

Re: Review Request 17006: Keep track of local pid and kill it on stopping all entities as discussed with John

2014-01-23 Thread John Fung
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17006/#review32632 --- There will be only 1 producer_performance running per entity_id. The

[jira] [Deleted] (KAFKA-1222) Rack-Aware replica assignment option

2014-01-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein deleted KAFKA-1222: - > Rack-Aware replica assignment option > > > Key: KAFKA-

[jira] [Deleted] (KAFKA-1220) Rack-Aware replica assignment option

2014-01-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein deleted KAFKA-1220: - > Rack-Aware replica assignment option > > > Key: KAFKA-

[jira] [Deleted] (KAFKA-1221) Rack-Aware replica assignment option

2014-01-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein deleted KAFKA-1221: - > Rack-Aware replica assignment option > > > Key: KAFKA-

[jira] [Deleted] (KAFKA-1224) Rack-Aware replica assignment option

2014-01-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein deleted KAFKA-1224: - > Rack-Aware replica assignment option > > > Key: KAFKA-

[jira] [Deleted] (KAFKA-1223) Rack-Aware replica assignment option

2014-01-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein deleted KAFKA-1223: - > Rack-Aware replica assignment option > > > Key: KAFKA-

[jira] [Deleted] (KAFKA-1225) Rack-Aware replica assignment option

2014-01-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein deleted KAFKA-1225: - > Rack-Aware replica assignment option > > > Key: KAFKA-

[jira] [Deleted] (KAFKA-1219) Rack-Aware replica assignment option

2014-01-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein deleted KAFKA-1219: - > Rack-Aware replica assignment option > > > Key: KAFKA-

[jira] [Deleted] (KAFKA-1218) Rack-Aware replica assignment option

2014-01-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein deleted KAFKA-1218: - > Rack-Aware replica assignment option > > > Key: KAFKA-

[jira] [Deleted] (KAFKA-1217) Rack-Aware replica assignment option

2014-01-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein deleted KAFKA-1217: - > Rack-Aware replica assignment option > > > Key: KAFKA-

[jira] [Assigned] (KAFKA-1217) Rack-Aware replica assignment option

2014-01-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein reassigned KAFKA-1217: Assignee: Joe Stein (was: Neha Narkhede) > Rack-Aware replica assignment option >

[jira] [Deleted] (KAFKA-1216) Rack-Aware replica assignment option

2014-01-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein deleted KAFKA-1216: - > Rack-Aware replica assignment option > > > Key: KAFKA-

[jira] [Updated] (KAFKA-1215) Rack-Aware replica assignment option

2014-01-23 Thread Joris Van Remoortere (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van Remoortere updated KAFKA-1215: Attachment: rack_aware_replica_assignment_v1.patch > Rack-Aware replica assignment