[jira] [Updated] (KAFKA-1030) Addition of partitions requires bouncing all the consumers of that topic

2013-09-06 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike updated KAFKA-1030: - Description: Consumer may not notice new partitions because the propagation of the metadata to s

Re: C++ client library for Apache Kafka v0.8+

2013-09-06 Thread Joe Stein
Yup, very awesome! /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop / On Thu, Sep 5, 201

[jira] [Commented] (KAFKA-1046) Added support for Scala 2.10 builds while maintaining compatibility with 2.8.x

2013-09-06 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13760334#comment-13760334 ] Neha Narkhede commented on KAFKA-1046: -- Is this a patch against trunk? Do you also wa

Re: C++ client library for Apache Kafka v0.8+

2013-09-06 Thread David Reynolds
Awesome work. I've been working on a pure C library for Apache Kafka. Maybe we can combine our efforts? Mine is still pretty rough, but if you want to take a look it's on github: https://github.com/davidreynolds/libkafka Best, David Reynolds On Fri, Sep 6, 2013 at 4:44 AM, Joe Stein wrote: >

Re: Segment recovery and replication

2013-09-06 Thread Sam Meder
Thinking about it some more I guess you are really talking about monitoring UnderReplicatedPartitionCount during a restart? /Sam On Sep 6, 2013, at 5:46 PM, Sam Meder wrote: > On Aug 29, 2013, at 11:12 PM, Neha Narkhede wrote: > How do you automate waiting for the broker to come up? Jus

[jira] [Created] (KAFKA-1046) Added support for Scala 2.10 builds while maintaining compatibility with 2.8.x

2013-09-06 Thread Christopher Freeman (JIRA)
Christopher Freeman created KAFKA-1046: -- Summary: Added support for Scala 2.10 builds while maintaining compatibility with 2.8.x Key: KAFKA-1046 URL: https://issues.apache.org/jira/browse/KAFKA-1046

Re: Segment recovery and replication

2013-09-06 Thread Joel Koshy
IIUC it is a pseudo-automation in that you set up the retry interval for controlled shutdown (controlled.shutdown.retry.backoff.ms) and the number of retries (controlled.shutdown.max.retries) high enough so that during a rolling bounce, the likelihood of a controlled shutdown being unsuccessful is

Re: Segment recovery and replication

2013-09-06 Thread Sam Meder
On Aug 29, 2013, at 11:12 PM, Neha Narkhede wrote: >>> How do you automate waiting for the broker to come up? Just keep > monitoring the process and keep trying to connect to the port? > > Every leader in a Kafka cluster exposes the UnderReplicatedPartitionCount > metric. The safest way to issue

[jira] [Commented] (KAFKA-1046) Added support for Scala 2.10 builds while maintaining compatibility with 2.8.x

2013-09-06 Thread Christopher Freeman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13760347#comment-13760347 ] Christopher Freeman commented on KAFKA-1046: The patch is made against trunk.

[jira] [Created] (KAFKA-1047) Typo in Documentation for Kafka, change "on" to "one"

2013-09-06 Thread Jim Plush (JIRA)
Jim Plush created KAFKA-1047: Summary: Typo in Documentation for Kafka, change "on" to "one" Key: KAFKA-1047 URL: https://issues.apache.org/jira/browse/KAFKA-1047 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-1046) Added support for Scala 2.10 builds while maintaining compatibility with 2.8.x

2013-09-06 Thread Christopher Freeman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Freeman updated KAFKA-1046: --- Attachment: kafka_2_10_refactor.patch the diff > Added support for S

[jira] [Created] (KAFKA-1048) Type in Documentation for Kafka - server to serve

2013-09-06 Thread Jim Plush (JIRA)
Jim Plush created KAFKA-1048: Summary: Type in Documentation for Kafka - server to serve Key: KAFKA-1048 URL: https://issues.apache.org/jira/browse/KAFKA-1048 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-1049) Encoder implementations are required to provide an undocumented constructor.

2013-09-06 Thread Jason Rosenberg (JIRA)
Jason Rosenberg created KAFKA-1049: -- Summary: Encoder implementations are required to provide an undocumented constructor. Key: KAFKA-1049 URL: https://issues.apache.org/jira/browse/KAFKA-1049 Projec

[jira] [Commented] (KAFKA-1049) Encoder implementations are required to provide an undocumented constructor.

2013-09-06 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13760940#comment-13760940 ] Jason Rosenberg commented on KAFKA-1049: I posed this issue to the kafka users mai