Re: Data (re)processing with Kafka (new wiki page)

2016-11-25 Thread Michael Noll
Thanks a lot, Matthias! I have already begun to provide feedback. -Michael On Wed, Nov 23, 2016 at 11:41 PM, Matthias J. Sax wrote: > Hi, > > we added a new wiki page that is supposed to collect data (re)processing > scenario with Kafka: > > https://cwiki.apache.org/confluence/display/KAFKA/

[jira] [Commented] (KAFKA-4434) KafkaProducer configuration is logged twice

2016-11-25 Thread Ruben de Gooijer (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15695660#comment-15695660 ] Ruben de Gooijer commented on KAFKA-4434: - Yeah sure. > KafkaProducer configur

Re: [DISCUSS] 0.10.1.1 Plan

2016-11-25 Thread Ismael Juma
Good, seems like we are in agreement about sticking to bug fixes for 0.10.1.1. Regarding the removal of final, I understand that it doesn't break backwards binary compatibility (it does break forwards compatibility and hence why it's more suited for feature releases; these are the same rules follo

[jira] [Created] (KAFKA-4446) If consumer offset topic created with less replicas than min.insync.replicas, consuming is not possible

2016-11-25 Thread Oliver Deakin (JIRA)
Oliver Deakin created KAFKA-4446: Summary: If consumer offset topic created with less replicas than min.insync.replicas, consuming is not possible Key: KAFKA-4446 URL: https://issues.apache.org/jira/browse/KAFKA-4

[jira] [Updated] (KAFKA-4446) If consumer offset topic created with less replicas than min.insync.replicas, consuming is not possible

2016-11-25 Thread Oliver Deakin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oliver Deakin updated KAFKA-4446: - Description: This is a bit of an edge case but it has a high impact. I have seen an issue multipl

[jira] [Updated] (KAFKA-4446) If consumer offset topic created with less replicas than min.insync.replicas, consuming is not possible

2016-11-25 Thread Oliver Deakin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oliver Deakin updated KAFKA-4446: - Description: This is a bit of an edge case but it has a high impact. I have seen an issue multipl

[jira] [Updated] (KAFKA-4446) If consumer offset topic created with less replicas than min.insync.replicas, consuming is not possible

2016-11-25 Thread Oliver Deakin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oliver Deakin updated KAFKA-4446: - Description: This is a bit of an edge case but it has a high impact. I have seen an issue multipl

[jira] [Commented] (KAFKA-4403) Update KafkaBasedLog to use new endOffsets consumer API

2016-11-25 Thread Balint Molnar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696141#comment-15696141 ] Balint Molnar commented on KAFKA-4403: -- Hi, Can I work on this? > Update KafkaBasedL

[GitHub] kafka pull request #2171: KAFKA-4427: Skip topic groups with no tasks

2016-11-25 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/2171 KAFKA-4427: Skip topic groups with no tasks You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka KAFKA-4427-topicgroups-with-n

[jira] [Commented] (KAFKA-4427) Skip topicGroups with no tasks

2016-11-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696165#comment-15696165 ] ASF GitHub Bot commented on KAFKA-4427: --- GitHub user enothereska opened a pull reque

Re: Data (re)processing with Kafka (new wiki page)

2016-11-25 Thread saiprasad mishra
This page is really helpful.Thanks for putting this Some nice to have features can be (not sure for this wiki page) 1) Pause and resume without having to start and stop. It should drain all the inflight calculations before doing the actual pause and a notifier will be helpful that it is actually

[jira] [Commented] (KAFKA-4446) If consumer offset topic created with less replicas than min.insync.replicas, consuming is not possible

2016-11-25 Thread Mickael Maison (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696259#comment-15696259 ] Mickael Maison commented on KAFKA-4446: --- I believe this is a DUP of https://issues.a

[jira] [Created] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-11-25 Thread Json Tu (JIRA)
Json Tu created KAFKA-4447: -- Summary: Controller resigned but it also acts as a controller for a long time Key: KAFKA-4447 URL: https://issues.apache.org/jira/browse/KAFKA-4447 Project: Kafka Issu

[jira] [Updated] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-11-25 Thread Json Tu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Json Tu updated KAFKA-4447: --- Attachment: log.tar.gz I upload the log's tar, we can unzip it using tar tools > Controller resigned but it a

[jira] [Resolved] (KAFKA-4446) If consumer offset topic created with less replicas than min.insync.replicas, consuming is not possible

2016-11-25 Thread Oliver Deakin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oliver Deakin resolved KAFKA-4446. -- Resolution: Duplicate Dupe of KAFKA-3959. > If consumer offset topic created with less replicas

[jira] [Commented] (KAFKA-4446) If consumer offset topic created with less replicas than min.insync.replicas, consuming is not possible

2016-11-25 Thread Oliver Deakin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696333#comment-15696333 ] Oliver Deakin commented on KAFKA-4446: -- Thanks [~mimaison], I think you're right. I'l

[jira] [Commented] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-11-25 Thread Json Tu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696340#comment-15696340 ] Json Tu commented on KAFKA-4447: after check the email's response in the dev's mail list,I

[jira] [Work started] (KAFKA-4427) Skip topicGroups with no tasks

2016-11-25 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4427 started by Eno Thereska. --- > Skip topicGroups with no tasks > -- > >

[jira] [Commented] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-11-25 Thread Json Tu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696353#comment-15696353 ] Json Tu commented on KAFKA-4447: after review the code of kafka 0.9.0.0 and some new versi

[jira] [Comment Edited] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-11-25 Thread Json Tu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696340#comment-15696340 ] Json Tu edited comment on KAFKA-4447 at 11/25/16 5:27 PM: -- after

[jira] [Updated] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-11-25 Thread Json Tu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Json Tu updated KAFKA-4447: --- Reviewer: Guozhang Wang > Controller resigned but it also acts as a controller for a long time >

Re: A strange controller log in Kafka 0.9.0.1

2016-11-25 Thread Json Tu
thanks guozhang, if it's convenient,can we disscuss it in the jira https://issues.apache.org/jira/browse/KAFKA-4447 ,I guess some body may also encounter this problem. > 在 2016年11月25日,下午12:31,Guozhang Wang 写道: > > Does broker 100 keeps

[jira] [Comment Edited] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-11-25 Thread Json Tu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696340#comment-15696340 ] Json Tu edited comment on KAFKA-4447 at 11/25/16 5:38 PM: -- after

[jira] [Comment Edited] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-11-25 Thread Json Tu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696353#comment-15696353 ] Json Tu edited comment on KAFKA-4447 at 11/25/16 5:39 PM: -- after

[jira] [Comment Edited] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-11-25 Thread Json Tu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696353#comment-15696353 ] Json Tu edited comment on KAFKA-4447 at 11/25/16 5:40 PM: -- after

[jira] [Commented] (KAFKA-4403) Update KafkaBasedLog to use new endOffsets consumer API

2016-11-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696374#comment-15696374 ] Ewen Cheslack-Postava commented on KAFKA-4403: -- Absolutely, I've assigned the

[jira] [Updated] (KAFKA-4403) Update KafkaBasedLog to use new endOffsets consumer API

2016-11-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4403: - Assignee: Balint Molnar (was: Ewen Cheslack-Postava) > Update KafkaBasedLog to us

[GitHub] kafka pull request #2172: HOTFIX: KAFKA-4245 follow up: remove gradle wrappe...

2016-11-25 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/2172 HOTFIX: KAFKA-4245 follow up: remove gradle wrapper, fix file headers so Rat checks pass, and move Travis cluster file into travis directory. You can merge this pull request into a Git repository b

[jira] [Commented] (KAFKA-4245) BlockingChannel#connect hides all exceptions

2016-11-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696542#comment-15696542 ] ASF GitHub Bot commented on KAFKA-4245: --- GitHub user ewencp opened a pull request:

[jira] [Commented] (KAFKA-4430) Broker logging "Topic and partition to exceptions: [topic,6] -> kafka.common.MessageSizeTooLargeException"

2016-11-25 Thread Srinivas Dhruvakumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696670#comment-15696670 ] Srinivas Dhruvakumar commented on KAFKA-4430: - I inspected the payloads and lo

[jira] [Created] (KAFKA-4448) Add missing licenses to ducktape related files

2016-11-25 Thread Raghav Kumar Gautam (JIRA)
Raghav Kumar Gautam created KAFKA-4448: -- Summary: Add missing licenses to ducktape related files Key: KAFKA-4448 URL: https://issues.apache.org/jira/browse/KAFKA-4448 Project: Kafka Issu

[jira] [Comment Edited] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-11-25 Thread Json Tu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696340#comment-15696340 ] Json Tu edited comment on KAFKA-4447 at 11/26/16 1:16 AM: -- after

[jira] [Comment Edited] (KAFKA-4447) Controller resigned but it also acts as a controller for a long time

2016-11-25 Thread Json Tu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696353#comment-15696353 ] Json Tu edited comment on KAFKA-4447 at 11/26/16 1:17 AM: -- after

Re: [DISCUSS] 0.10.1.1 Plan

2016-11-25 Thread Michael Pearce
As agreed that this should be purely a bug fix release for stability. I'd like to flag then we shouldn't be adding / merging in any Jira's that are not bugs. e.g. KAFKA-4438 From: isma...@gmail.com on behalf of Ismael Juma Sent: Friday, November 25,