Re: Kafka Rebalance on Watcher event Question

2015-05-11 Thread dinesh kumar
Thanks Manikumar for you super fast replies. Let me go through the docs and will raise my questions, if any. Thanks, Dinesh On 11 May 2015 at 11:46, Manikumar Reddy wrote: > All the consumers in the same consumer group will share the load across > given topic/partitions. > So for any consumer f

Re: Kafka Rebalance on Watcher event Question

2015-05-10 Thread Manikumar Reddy
All the consumers in the same consumer group will share the load across given topic/partitions. So for any consumer failure, there will be a re-balance to assign the failed topic/partitions to live consumers. pl check consumer documentation here https://kafka.apache.org/documentation.html#introduc

Re: Kafka Rebalance on Watcher event Question

2015-05-10 Thread dinesh kumar
But why? What is reason for triggering a rebalance if none of the topics of a consumers are affected? Is there some reason for triggering a rebalance irrespective of the consumers topics getting affected ? On 11 May 2015 at 11:06, Manikumar Reddy wrote: > If both C1,C2 belongs to same consumer

Re: Kafka Rebalance on Watcher event Question

2015-05-10 Thread Manikumar Reddy
If both C1,C2 belongs to same consumer group, then the re-balance will be triggered. A consumer subscribes to event changes of the consumer id registry within its group. On Mon, May 11, 2015 at 10:55 AM, dinesh kumar wrote: > Hi, > I am looking at the code of kafka.consumer.ZookeeperConsumerConn

Kafka Rebalance on Watcher event Question

2015-05-10 Thread dinesh kumar
Hi, I am looking at the code of kafka.consumer.ZookeeperConsumerConnector.scala (link here ) and I see that all ids registered to a particular group ids are registered to the path /consu