Re: About kafka 0.8 producer auto detect broker

2013-01-15 Thread Neha Narkhede
> Can I guess that the auto detecting ability for producer is weakened in > Kafka 0.8? Why you get rid of zookeeper from producer in Kafka 0.8? In 0.8, we got rid of zookeeper from the producer and replaced its functionality with a metadata API. On startup and whenever a request fails, the produc

Re: About kafka 0.8 producer auto detect broker

2013-01-15 Thread Jun Rao
That's an experiment for a future release. The consumer logic in 0.8 is more or less the same as 0.7, ie, running in a decentralized way. Thanks, Jun On Tue, Jan 15, 2013 at 12:10 AM, gj1989lh wrote: > Hi, > How is the consumer rebalancing works? > In the design part of the official document,

About kafka 0.8 producer auto detect broker

2013-01-15 Thread gj1989lh
Hi, How is the consumer rebalancing works? In the design part of the official document, it says each consumer decides which partitions it should own. But in below document https://cwiki.apache.org/confluence/display/KAFKA/Central+Consumer+Coordination It says there will be a centralized consumer c

About kafka 0.8 producer auto detect broker

2013-01-14 Thread gj1989lh
Hi, We know in Kafka 0.7, we can specify zk.connect. And with zookeeper, the producer can dynamically detect broker. But in Kafka 0.8, we can't specify zk.connect for producer. How does the producer in Kafka 0.8 auto detect broker? I have done two experiments. In first one, I configure the broke