Re: consumer partition rebalancing

2013-09-11 Thread Kam Kasravi
t; >> From: Joel Koshy >> To: "users@kafka.apache.org" ; Kam Kasravi >> >> Sent: Tuesday, September 10, 2013 4:36 PM >> Subject: Re: consumer partition rebalancing >> >> >>>* Assuming 1) theconsumerdoesn&

Re: consumer partition rebalancing

2013-09-11 Thread Joel Koshy
rebalancing when another consumer > in it's group joins or a new broker joins or a new topic is created? > > > > From: Joel Koshy > To: "users@kafka.apache.org" ; Kam Kasravi > > Sent: Tuesday, September 10, 2013 4:3

Re: consumer partition rebalancing

2013-09-11 Thread Kam Kasravi
quot;users@kafka.apache.org" ; Kam Kasravi Sent: Tuesday, September 10, 2013 4:36 PM Subject: Re: consumer partition rebalancing >        * Assuming 1) theconsumerdoesn'tcontrolthe partition allocation >within a topic and 2) theconstraintthat a single consumer C(i) within a >co

Re: consumer partition rebalancing

2013-09-10 Thread Joel Koshy
> * Assuming 1) theconsumerdoesn'tcontrolthe partition allocation > within a topic and 2) theconstraintthat a single consumer C(i) within a > consumer group C(g) must be the only reader of that partition: > * Are there ways to scale partition consumption if C(i) cannot keep > up?

consumer partition rebalancing

2013-09-10 Thread Kam Kasravi
I wasreviewingtheconsumer partition rebalancingalgorithm and had a fewrelatedquestions  * Assuming 1) theconsumerdoesn'tcontrolthe partition allocation within a topic and 2) theconstraintthat a single consumer C(i) within a consumer group C(g) must be the only reader of that partition: