Hi! Thank you for your answer. Ithelps me since it confirms me the observations (I'm not the only one :)). I could not find the documentation that states this clear "Rebalance is performed at the group level no matter from what topic your are consuming that belongs to it. " The pictures that I've seen in the documentation were related to a single topic, therefore the confusion. I have found also an article related with a past version of Kafka, that had the same behavior: https://olnrao.wordpress.com/2015/05/15/apache-kafka-case-of-mysterious-rebalances/ . In my opinion this part should be better explained in the release documentation, since is one of the most important part of consuming. Regards, Florin
On Tue, May 10, 2016 at 4:06 PM, John Holland < john.holl...@objectpartners.com> wrote: > I haven't browsed the source for the rebalance algorithm but anecdotally It > appears this is the case. In our system we have a consumer group whose > application instances are not only scaled but also split by topics (some > topics have much higher message rates). When we perform a deployment of > one of the split instances it causes all consumers across all instances in > that group to rebalance, even those not consuming that specific topic. > > In my opinion I wouldn't split the consumer group deployment by topics as > we have done but treat each consumer group as an "application identifier" > and scale that way only. > > Not sure if that helps or not. > > -John > > On Tue, May 10, 2016 at 3:50 AM Spico Florin <spicoflo...@gmail.com> > wrote: > > > I have 3 topics A,B,C with same number of partitions. I use the same > group > > name for all the consumers to this topics. > > My questions are: > > > > 1. If a consumer for one of the topics/partitions will rebalance be > > triggered for the other two topics consumers? > > > > 2. Same if adding a new partition for one topic, will rebalance be > > triggered for the other two topics consumers? > > > > 3. More general, the consumers rebalance occurs at the group level no > > matter from what topics are consuming (considering they have the same > group > > name)? > > > > I look forward for your answers. > > > > Regards, > > Florin > > >
