[jira] [Updated] (KAFKA-1207) Launch Kafka from within Apache Mesos

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1207: - Status: Patch Available (was: Open) > Launch Kafka from within Apache Mesos > --

[jira] [Updated] (KAFKA-1207) Launch Kafka from within Apache Mesos

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1207: - Status: Open (was: Patch Available) > Launch Kafka from within Apache Mesos > --

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Status: Patch Available (was: Open) > allow Kafka to start from a resource negotiator system > -

Re: Kafka server start from resource negotiator(s)

2014-01-15 Thread Joe Stein
Right now I am testing it that way. Once it is working and if that becomes a problem then moving it into a mesosFramework project is no problem. if we do that it would be beneficial if they were organized under some resource manager folder or something. The way I wrote https://issues.apache.org/

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: KAFKA-1206_2014-01-16_00:39:12.patch > allow Kafka to start from a resource negotiator system

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: (was: KAFKA-1206_2014-01-16_00:39:12.patch) > allow Kafka to start from a resource negoti

[jira] [Commented] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873065#comment-13873065 ] Joe Stein commented on KAFKA-1206: -- Updated reviewboard https://reviews.apache.org/r/1692

[jira] [Commented] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873064#comment-13873064 ] Joe Stein commented on KAFKA-1206: -- Updated reviewboard https://reviews.apache.org/r/1692

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: KAFKA-1206_2014-01-16_00:40:30.patch > allow Kafka to start from a resource negotiator system

Re: Review Request 16923: Patch for KAFKA-1206

2014-01-15 Thread Joe Stein
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16923/ --- (Updated Jan. 16, 2014, 5:40 a.m.) Review request for kafka. Bugs: KAFKA-1206

Re: Review Request 16923: Patch for KAFKA-1206

2014-01-15 Thread Joe Stein
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16923/ --- (Updated Jan. 16, 2014, 5:39 a.m.) Review request for kafka. Bugs: KAFKA-1206

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: (was: KAFKA-1206_2014-01-16_00:36:52.patch) > allow Kafka to start from a resource negoti

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: (was: KAFKA-1206.patch) > allow Kafka to start from a resource negotiator system > --

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: KAFKA-1206_2014-01-16_00:36:52.patch > allow Kafka to start from a resource negotiator system

Re: Review Request 16923: Patch for KAFKA-1206

2014-01-15 Thread Joe Stein
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16923/ --- (Updated Jan. 16, 2014, 5:37 a.m.) Review request for kafka. Bugs: KAFKA-1206

[jira] [Commented] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873063#comment-13873063 ] Joe Stein commented on KAFKA-1206: -- Updated reviewboard https://reviews.apache.org/r/1692

Re: Kafka server start from resource negotiator(s)

2014-01-15 Thread Jun Rao
Hi, Joe, Thanks for looking into this. Do you plan to add a dependency to Mesos in kafka jar? Jun On Wed, Jan 15, 2014 at 10:50 AM, Joe Stein wrote: > Hi, I am working at adding some code to the kafka.Kafka.scala file. > > What I was thinking for the Utils.loadProps is to create some > Resour

Re: Review Request 16360: Fix the offset bug while adding fetchers

2014-01-15 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16360/#review32002 --- Looks good. Just a couple of minor comments. core/src/main/scala/k

[jira] [Resolved] (KAFKA-1208) Update system test still to use kafka-topics instead of kafka-create-topics shell

2014-01-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-1208. Resolution: Fixed Thanks for the patch. +1 and committed to trunk. > Update system test still to use kafka

[jira] [Updated] (KAFKA-1208) Update system test still to use kafka-topics instead of kafka-create-topics shell

2014-01-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1208: - Attachment: KAFKA-1208.patch > Update system test still to use kafka-topics instead of kafka-crea

[jira] [Commented] (KAFKA-1208) Update system test still to use kafka-topics instead of kafka-create-topics shell

2014-01-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873013#comment-13873013 ] Guozhang Wang commented on KAFKA-1208: -- Created reviewboard https://reviews.apache.or

Review Request 16944: Use kafka-topics for system-test

2014-01-15 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16944/ --- Review request for kafka. Bugs: KAFKA-1208 https://issues.apache.org/jira/b

Re: development branches in git

2014-01-15 Thread Guozhang Wang
For mos of the JIRAs one person is mainly in charge of the patch. For large JIRAs that would need multiple sub-tickets we can just assign different people on sub-tasks. That said, I think it makes sense to create branch when the development period would take long (> 1 month, say), and hence consec

development branches in git

2014-01-15 Thread Joe Stein
What are folks thoughts about development branches with the branch being the ticket number? I think it should continue to follow the bylaws but how do we vote in the initial commit? Can a committer just +1 whether the JIRA ticket gets a branch or can we have it so committer (even if committer is

Re: Review Request 16360: Fix the offset bug while adding fetchers

2014-01-15 Thread Guozhang Wang
> On Jan. 7, 2014, 5:12 p.m., Neha Narkhede wrote: > > In general, does the alternate approach of sending all commands to every > > broker and let the broker ignore a become follower if it is for the same > > leader as the current one? The reason why this would work is because all > > controll

[jira] [Commented] (KAFKA-1188) Stale LeaderAndIsr request could be handled by the broker on Controller failover

2014-01-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13872882#comment-13872882 ] Guozhang Wang commented on KAFKA-1188: -- Updated reviewboard https://reviews.apache.or

[jira] [Updated] (KAFKA-1188) Stale LeaderAndIsr request could be handled by the broker on Controller failover

2014-01-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1188: - Attachment: KAFKA-1188_2014-01-15_16:43:30.patch > Stale LeaderAndIsr request could be handled by

Re: Review Request 16360: Fix the offset bug while adding fetchers

2014-01-15 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16360/ --- (Updated Jan. 16, 2014, 12:43 a.m.) Review request for kafka. Summary (update

[jira] [Created] (KAFKA-1209) System test transient failure due to ProducerPerformance's connection to servers kept broken

2014-01-15 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-1209: Summary: System test transient failure due to ProducerPerformance's connection to servers kept broken Key: KAFKA-1209 URL: https://issues.apache.org/jira/browse/KAFKA-1209

[jira] [Created] (KAFKA-1208) Update system test still to use kafka-topics instead of kafka-create-topics shell

2014-01-15 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-1208: Summary: Update system test still to use kafka-topics instead of kafka-create-topics shell Key: KAFKA-1208 URL: https://issues.apache.org/jira/browse/KAFKA-1208 Proje

[jira] [Commented] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13872749#comment-13872749 ] Joe Stein commented on KAFKA-1206: -- Created reviewboard https://reviews.apache.org/r/1692

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: KAFKA-1206.patch > allow Kafka to start from a resource negotiator system > -

Review Request 16923: Patch for KAFKA-1206

2014-01-15 Thread Joe Stein
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16923/ --- Review request for kafka. Bugs: KAFKA-1206 https://issues.apache.org/jira/b

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Description: We need a generic implementation to hold the property information for brokers, producers an

[jira] [Updated] (KAFKA-1207) Launch Kafka from within Apache Mesos

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1207: - Labels: mesos (was: ) > Launch Kafka from within Apache Mesos > - >

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Labels: mesos (was: ) > allow Kafka to start from a resource negotiator system > ---

[jira] [Created] (KAFKA-1207) Launch Kafka from within Apache Mesos

2014-01-15 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-1207: Summary: Launch Kafka from within Apache Mesos Key: KAFKA-1207 URL: https://issues.apache.org/jira/browse/KAFKA-1207 Project: Kafka Issue Type: Bug Repor

[jira] [Created] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-1206: Summary: allow Kafka to start from a resource negotiator system Key: KAFKA-1206 URL: https://issues.apache.org/jira/browse/KAFKA-1206 Project: Kafka Issue Type: Bug

Kafka server start from resource negotiator(s)

2014-01-15 Thread Joe Stein
Hi, I am working at adding some code to the kafka.Kafka.scala file. What I was thinking for the Utils.loadProps is to create some ResourceNegotiatedConfiguration class or something to sit with it so various frameworks can be supported. For Mesos I am thinking of storing the properties in zookeepe

[jira] [Commented] (KAFKA-1196) java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33

2014-01-15 Thread Gerrit Jansen van Vuuren (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13872281#comment-13872281 ] Gerrit Jansen van Vuuren commented on KAFKA-1196: - I've written a consumer

[jira] [Updated] (KAFKA-1020) Remove getAllReplicasOnBroker from KafkaController

2014-01-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1020: --- Resolution: Fixed Status: Resolved (was: Patch Available) Fixed as part of kafka-1202. > Remove get

[jira] [Resolved] (KAFKA-1202) optimize ZK access in KafkaController

2014-01-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-1202. Resolution: Fixed Fix Version/s: 0.8.1 Thanks for the review. Committed to trunk. Also, incorporated

[jira] [Commented] (KAFKA-1196) java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33

2014-01-15 Thread Gerrit Jansen van Vuuren (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13872215#comment-13872215 ] Gerrit Jansen van Vuuren commented on KAFKA-1196: - :) , it doesn't seem li

[jira] [Commented] (KAFKA-1196) java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33

2014-01-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13872210#comment-13872210 ] Jun Rao commented on KAFKA-1196: Yes, I wasn't thinking of fixing the issue since I can't