Re: owner info in zk is not correct

2014-05-22 Thread Helin Xiang
Hi Guozhang, sorry for asking a little unrelated problem here. We found a consumer stopping fetching data when doing an network upgrade, if the consumer have connection problem with one broker (but OK with zookeeper and other brokers) the fetcherrunnable will stop, but there is no chance to resta

Re: New Metrics Reporter for Graphite

2014-05-22 Thread pushkar priyadarshi
Hello Damien, Im also using same thing for pushing to graphite(forked from gangalia) but i dont see default jvm paramaters like OS metrics being pushed to graphite?Have you checked your version.Are you able to push these metrices as well. On Thu, May 22, 2014 at 8:02 PM, Jun Rao wrote: > Thanks

Re: release roadmap

2014-05-22 Thread Jun Rao
The new producer client is available in trunk. We plan to release that in the next release (0.8.2). The new consumer client is being developed now and will be released after that. I updated that wiki. Thanks, Jun On Thu, May 22, 2014 at 2:51 PM, Kane Kane wrote: > Hello, > > According to this

Re: kafka broker failed to recovery from ZK failure

2014-05-22 Thread Jun Rao
Delete topic is not supported in 0.8.1.1. How did you do it? Thanks, Jun On Thu, May 22, 2014 at 9:59 AM, Steven Wu wrote: > yes. I deleted a topic. but not at the time. it's a few hours before. > > > On Fri, May 16, 2014 at 3:49 PM, Jun Rao wrote: > > > The problem is indicated by the follo

release roadmap

2014-05-22 Thread Kane Kane
Hello, According to this: https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan 0.9 supposed to be released around this time. Is there any updated release plans, I am particularly interested when 0.9 will be released approximately. Thanks.

Re: common client for 0.7.2 & 0.8 clusters?

2014-05-22 Thread Joel Koshy
Hi David, It is not possible to use the 0.7 clients with an 0.8 clients and vice-versa. i.e., the migration tool approach is the only option to transition fro 0.7 to 0.8. Joel On Thu, May 22, 2014 at 01:53:40PM -0400, David McWhorter wrote: > Hi all, we have an application that needs to support

common client for 0.7.2 & 0.8 clusters?

2014-05-22 Thread David McWhorter
Hi all, we have an application that needs to support producing and consuming data to/from kafka 0.7.2 and 0.8 clusters in different environments. I understand that the 0.8 release was a substantial change and that a cluster itself cannot be upgraded from 0.7 to 0.8 as normal and you must foll

Re: kafka broker failed to recovery from ZK failure

2014-05-22 Thread Steven Wu
yes. I deleted a topic. but not at the time. it's a few hours before. On Fri, May 16, 2014 at 3:49 PM, Jun Rao wrote: > The problem is indicated by the following log in broker 1's controller log. > Were you deleting any topic at that time? > > [2014-05-12 21:24:37,930] ERROR [BrokerChangeListen

Re: reduce replication factor

2014-05-22 Thread David Birdsong
On Thu, May 22, 2014 at 7:29 AM, Jun Rao wrote: > That's exactly what partition reassignment does. It may take a bit of time > for the reassignment to complete. > > For example, if you initiate the process to change the replica assignment > from {1, 2, 3} to {4,5,6}, the values in the assigned re

Re: reduce replication factor

2014-05-22 Thread Jun Rao
That's exactly what partition reassignment does. It may take a bit of time for the reassignment to complete. For example, if you initiate the process to change the replica assignment from {1, 2, 3} to {4,5,6}, the values in the assigned replica (AR) and leader/isr path in ZK may go through the fol

Re: Unable to scale kafka cluster

2014-05-22 Thread Jun Rao
Have you looked at https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-CanIaddnewbrokersdynamicallytoacluster ? Thanks, Jun On Thu, May 22, 2014 at 4:33 AM, Ertuğrul Yılmaz < ertugrul.yil...@convertale.com> wrote: > Hi Kafka User and Dev team, > > We want to use kafka to scale high traff

Re: New Metrics Reporter for Graphite

2014-05-22 Thread Jun Rao
Thanks for sharing. Added to the wiki. Jun On Thu, May 22, 2014 at 12:33 AM, Damien Claveau wrote: > Hi, > > I have released an additionnal MetricsReporter for Graphite. > > It is basically a fork from the kafka-ganglia project on Github, > and it is available here : https://github.com/damiencl

Unable to scale kafka cluster

2014-05-22 Thread Ertuğrul Yılmaz
Hi Kafka User and Dev team, We want to use kafka to scale high traffic load. My plan is adding new kafka instances to the cluster regarding the current load. In order to achieve this, we have executed some producer tests and want to learn how we can scale kafka cluster. Our test environments and c

New Metrics Reporter for Graphite

2014-05-22 Thread Damien Claveau
Hi, I have released an additionnal MetricsReporter for Graphite. It is basically a fork from the kafka-ganglia project on Github, and it is available here : https://github.com/damienclaveau/kafka-graphite Dear Jun, you could maybe add the link in the wiki here : https://cwiki.apache.org/confluen