Great, thanks for the info! Michael Golowka ________________________________________ From: Neha Narkhede [neha.narkh...@gmail.com] Sent: Friday, April 19, 2013 4:04 PM To: users@kafka.apache.org Subject: Re: Consumers vs Partitions
sum of all partitions across multiple brokers, so 20. Thanks, Neha On Fri, Apr 19, 2013 at 2:56 PM, Michael Golowka <michael.golo...@returnpath.com> wrote: > Is the number of partitions calculated based on an individual broker, or a > sum of all partitions across multiple brokers? For instance, if I have 2 > brokers with 10 partitions each, is the maximum active consumers 10 or 20? > > Michael Golowka > ________________________________________ > From: Neha Narkhede [neha.narkh...@gmail.com] > Sent: Friday, April 19, 2013 3:53 PM > To: users@kafka.apache.org > Subject: Re: Consumers vs Partitions > > That is correct, you cannot have more active consumers than the total > # of partitions. > > Thanks, > Neha > > On Fri, Apr 19, 2013 at 2:30 PM, Michael Golowka > <michael.golo...@returnpath.com> wrote: >> What is the relationship between topic partitions and consumers? From what >> I've read and experimented with, the number of partitions limits the number >> of active consumers in a given consumer group on a given topic. So if the >> number of partitions is 10, and the number of consumers is 12 (all in the >> same group), 2 consumers will not receive any data unless one of the active >> consumers dies. Is this correct? Is there a way that you can have more >> consumers than partitions? >> >> Thanks! >> >> >> Michael Golowka