[jira] [Updated] (KAFKA-1127) kafka and zookeeper server should start in daemon mode and log to correct position

2013-11-07 Thread Raymond Liu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Liu updated KAFKA-1127: --- Attachment: kafka-1127-v2.patch So this one is combined patch with KAFKA-1109 > kafka and zookeeper

[jira] [Comment Edited] (KAFKA-1127) kafka and zookeeper server should start in daemon mode and log to correct position

2013-11-07 Thread Raymond Liu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13817020#comment-13817020 ] Raymond Liu edited comment on KAFKA-1127 at 11/8/13 5:50 AM: -

[jira] [Commented] (KAFKA-1110) Unable to produce messages with snappy/gzip compression

2013-11-07 Thread Arup Malakar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13817016#comment-13817016 ] Arup Malakar commented on KAFKA-1110: - May be Evan would be able to provide more infor

[jira] [Commented] (KAFKA-1127) kafka and zookeeper server should start in daemon mode and log to correct position

2013-11-07 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816995#comment-13816995 ] Guozhang Wang commented on KAFKA-1127: -- Thanks for the patch. Could this jira be merg

[jira] [Commented] (KAFKA-1110) Unable to produce messages with snappy/gzip compression

2013-11-07 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816991#comment-13816991 ] Joe Stein commented on KAFKA-1110: -- Hey Evan, if the issue is not occurring without compr

[jira] [Updated] (KAFKA-1127) kafka and zookeeper server should start in daemon mode and log to correct position

2013-11-07 Thread Raymond Liu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Liu updated KAFKA-1127: --- Attachment: kafka-1127.patch > kafka and zookeeper server should start in daemon mode and log to corr

[jira] [Updated] (KAFKA-1127) kafka and zookeeper server should start in daemon mode and log to correct position

2013-11-07 Thread Raymond Liu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Liu updated KAFKA-1127: --- Affects Version/s: 0.9 Status: Patch Available (was: Open) > kafka and zookeeper serv

[jira] [Created] (KAFKA-1127) kafka and zookeeper server should start in daemon mode and log to correct position

2013-11-07 Thread Raymond Liu (JIRA)
Raymond Liu created KAFKA-1127: -- Summary: kafka and zookeeper server should start in daemon mode and log to correct position Key: KAFKA-1127 URL: https://issues.apache.org/jira/browse/KAFKA-1127 Project:

[jira] [Commented] (KAFKA-1110) Unable to produce messages with snappy/gzip compression

2013-11-07 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816949#comment-13816949 ] Evan Huus commented on KAFKA-1110: -- I don't know how to make it work. The provided Consol

[jira] [Resolved] (KAFKA-1119) Kafka 0.8.1 overwrites previous per topic config changes

2013-11-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede resolved KAFKA-1119. -- Resolution: Fixed Thanks for the reviews! Pushed to trunk. > Kafka 0.8.1 overwrites previous p

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread joel koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15274/#review28481 --- Ship it! - joel koshy On Nov. 8, 2013, 1:07 a.m., Neha Narkhede w

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread joel koshy
> On Nov. 7, 2013, 6:29 p.m., joel koshy wrote: > > core/src/main/scala/kafka/admin/AdminUtils.scala, line 224 > > > > > > Not sure if this is required any more if we're doing validation earlier > > - since a validati

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread joel koshy
> On Nov. 7, 2013, 6:31 p.m., joel koshy wrote: > > core/src/main/scala/kafka/admin/TopicCommand.scala, line 153 > > > > > > Also, if we are adding the deleteConfig option we need not use the same > > regex and split.

[jira] [Updated] (KAFKA-1126) Remove the DISCLAIMER it is left over from incubation

2013-11-07 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1126: - Resolution: Fixed Status: Resolved (was: Patch Available) > Remove the DISCLAIMER it is left ove

[jira] [Commented] (KAFKA-1126) Remove the DISCLAIMER it is left over from incubation

2013-11-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816883#comment-13816883 ] Neha Narkhede commented on KAFKA-1126: -- +1 > Remove the DISCLAIMER it is left over f

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread Neha Narkhede
> On Nov. 7, 2013, 6:31 p.m., joel koshy wrote: > > core/src/main/scala/kafka/admin/TopicCommand.scala, line 153 > > > > > > Also, if we are adding the deleteConfig option we need not use the same > > regex and split.

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread Neha Narkhede
> On Nov. 7, 2013, 6:29 p.m., joel koshy wrote: > > core/src/main/scala/kafka/admin/AdminUtils.scala, line 224 > > > > > > Not sure if this is required any more if we're doing validation earlier > > - since a validati

[jira] [Commented] (KAFKA-1119) Kafka 0.8.1 overwrites previous per topic config changes

2013-11-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816877#comment-13816877 ] Neha Narkhede commented on KAFKA-1119: -- Updated reviewboard https://reviews.apache.or

[jira] [Updated] (KAFKA-1119) Kafka 0.8.1 overwrites previous per topic config changes

2013-11-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1119: - Attachment: KAFKA-1119_2013-11-07_17:07:18.patch > Kafka 0.8.1 overwrites previous per topic conf

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15274/ --- (Updated Nov. 8, 2013, 1:07 a.m.) Review request for kafka. Bugs: KAFKA-1119

[jira] [Commented] (KAFKA-1110) Unable to produce messages with snappy/gzip compression

2013-11-07 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816862#comment-13816862 ] Joe Stein commented on KAFKA-1110: -- Hey Evan, if you can get it to work that is a good ne

[jira] [Commented] (KAFKA-1122) Kafka can log giant log lines

2013-11-07 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816856#comment-13816856 ] Joe Stein commented on KAFKA-1122: -- You are both right, is there some type of patch we co

[jira] [Updated] (KAFKA-1122) Kafka can log giant log lines

2013-11-07 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1122: - Attachment: (was: KAFKA-1122.patch) > Kafka can log giant log lines > - >

[jira] [Updated] (KAFKA-1126) Remove the DISCLAIMER it is left over from incubation

2013-11-07 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1126: - Status: Patch Available (was: Open) > Remove the DISCLAIMER it is left over from incubation > --

[jira] [Updated] (KAFKA-1126) Remove the DISCLAIMER it is left over from incubation

2013-11-07 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1126: - Attachment: KAFKA-1122.patch > Remove the DISCLAIMER it is left over from incubation > --

[jira] [Updated] (KAFKA-1122) Kafka can log giant log lines

2013-11-07 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1122: - Attachment: KAFKA-1122.patch > Kafka can log giant log lines > - > >

Re: [VOTE] Apache Kafka Release 0.8.0 - Candidate 2

2013-11-07 Thread Joe Stein
The DISCLAIMER as a whole is not valid anymore and should just be removed IMHO (unless there are objections) since it is 100% about incubation. I will throw my -1 down on RC2 and shucks, what would a release be without at least three release candidates (better than nine I always say) Ok, so VOTE

[jira] [Created] (KAFKA-1126) Remove the DISCLAIMER it is left over from incubation

2013-11-07 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-1126: Summary: Remove the DISCLAIMER it is left over from incubation Key: KAFKA-1126 URL: https://issues.apache.org/jira/browse/KAFKA-1126 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-1122) Kafka can log giant log lines

2013-11-07 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816805#comment-13816805 ] Jason Rosenberg commented on KAFKA-1122: [~guozhang] I understand that point, but

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread Swapnil Ghike
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15274/#review28440 --- core/src/main/scala/kafka/admin/TopicCommand.scala

[jira] [Commented] (KAFKA-1036) Unable to rename replication offset checkpoint in windows

2013-11-07 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816331#comment-13816331 ] Timothy Chen commented on KAFKA-1036: - Hi Jay, The code isn't doing any locking, but

[jira] [Commented] (KAFKA-1036) Unable to rename replication offset checkpoint in windows

2013-11-07 Thread David Lao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816304#comment-13816304 ] David Lao commented on KAFKA-1036: -- Hi Jay, Can you provide a patch for 0.8 as well? I'm

Re: [VOTE] Apache Kafka Release 0.8.0 - Candidate 2

2013-11-07 Thread Joel Koshy
Joe, thanks for doing this. Couple of questions before I can vote because I'm not sure if any of these would block voting: >From below: > http://svn.apache.org/repos/asf/incubator/kafka/trunk/KEYS in addition to This link is out of date - should be http://svn.apache.org/repos/asf/kafka/KEYS In re

[jira] Subscription: outstanding kafka patches

2013-11-07 Thread jira
Issue Subscription Filter: outstanding kafka patches (72 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-1117 tool for checking the consistency among replicas https://issues.apache.org/jira/browse/KAFKA-1117 KAFKA-1116 Need to up

[jira] [Updated] (KAFKA-1125) Add options to let admin tools blocking until finish

2013-11-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1125: - Affects Version/s: 0.8.1 > Add options to let admin tools blocking until finish > ---

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread joel koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15274/#review28395 --- core/src/main/scala/kafka/admin/TopicCommand.scala

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread joel koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15274/#review28393 --- core/src/main/scala/kafka/admin/AdminUtils.scala

[jira] [Commented] (KAFKA-1119) Kafka 0.8.1 overwrites previous per topic config changes

2013-11-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816200#comment-13816200 ] Neha Narkhede commented on KAFKA-1119: -- Updated reviewboard https://reviews.apache.or

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread Neha Narkhede
> On Nov. 7, 2013, 5:57 p.m., joel koshy wrote: > > core/src/main/scala/kafka/admin/TopicCommand.scala, line 153 > > > > > > This convention should be fine, but personally would prefer an unconfig > > or del-config si

[jira] [Updated] (KAFKA-1119) Kafka 0.8.1 overwrites previous per topic config changes

2013-11-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1119: - Attachment: KAFKA-1119_2013-11-07_10:17:14.patch > Kafka 0.8.1 overwrites previous per topic conf

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15274/ --- (Updated Nov. 7, 2013, 6:17 p.m.) Review request for kafka. Bugs: KAFKA-1119

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread joel koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15274/#review28385 --- core/src/main/scala/kafka/admin/AdminUtils.scala

[jira] [Created] (KAFKA-1125) Add options to let admin tools blocking until finish

2013-11-07 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-1125: Summary: Add options to let admin tools blocking until finish Key: KAFKA-1125 URL: https://issues.apache.org/jira/browse/KAFKA-1125 Project: Kafka Issue Type

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread Guozhang Wang
> On Nov. 6, 2013, 9:41 p.m., Guozhang Wang wrote: > > Topic config change as well as create-topic, add-partition, > > partition-reassignment and preferred leader election are all asynchronous > > in the sense that the admin command would return immediately and one has to > > check himself if

[jira] [Updated] (KAFKA-1119) Kafka 0.8.1 overwrites previous per topic config changes

2013-11-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1119: - Attachment: KAFKA-1119_2013-11-07_09:50:20.patch > Kafka 0.8.1 overwrites previous per topic conf

[jira] [Commented] (KAFKA-1119) Kafka 0.8.1 overwrites previous per topic config changes

2013-11-07 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13816177#comment-13816177 ] Neha Narkhede commented on KAFKA-1119: -- Updated reviewboard https://reviews.apache.or

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15274/ --- (Updated Nov. 7, 2013, 5:50 p.m.) Review request for kafka. Bugs: KAFKA-1119

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread Neha Narkhede
> On Nov. 6, 2013, 10:42 p.m., Swapnil Ghike wrote: > > It will help to add a --deleteConfig option. We can use it as --config > > config1=newVal --deleteConfig config2. > > Neha Narkhede wrote: > Like we discussed offline, deleteConfig complicates the ability to accept > configs easily in

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15274/ --- (Updated Nov. 7, 2013, 4:50 p.m.) Review request for kafka. Changes ---

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread Neha Narkhede
> On Nov. 6, 2013, 9:41 p.m., Guozhang Wang wrote: > > Topic config change as well as create-topic, add-partition, > > partition-reassignment and preferred leader election are all asynchronous > > in the sense that the admin command would return immediately and one has to > > check himself if

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread Neha Narkhede
> On Nov. 6, 2013, 10:42 p.m., Swapnil Ghike wrote: > > It will help to add a --deleteConfig option. We can use it as --config > > config1=newVal --deleteConfig config2. Like we discussed offline, deleteConfig complicates the ability to accept configs easily in bulk and apply those. - Neha

Re: Leader no available for partiton error

2013-11-07 Thread Neha Narkhede
This is likely to happen if you don't do controlled shutdown - https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-1.ControlledShutdown Thanks, Neha On Thu, Nov 7, 2013 at 7:40 AM, Shafaq wrote: > Using 0.8 head > > I have a 2-node broker cluster, One of which

Leader no available for partiton error

2013-11-07 Thread Shafaq
Using 0.8 head I have a 2-node broker cluster, One of which I had to restart as it was down while the producers are pushing data into kafka broker for 2 topics. When the 2nd broker came up, I get exception in the broker below. The 2nd topic consumer is not getting any data. Why does not the lea