Is the number of partitions calculated based on an individual broker, or a sum of all partitions across multiple brokers? For instance, if I have 2 brokers with 10 partitions each, is the maximum active consumers 10 or 20?
Michael Golowka ________________________________________ From: Neha Narkhede [neha.narkh...@gmail.com] Sent: Friday, April 19, 2013 3:53 PM To: users@kafka.apache.org Subject: Re: Consumers vs Partitions That is correct, you cannot have more active consumers than the total # of partitions. Thanks, Neha On Fri, Apr 19, 2013 at 2:30 PM, Michael Golowka <michael.golo...@returnpath.com> wrote: > What is the relationship between topic partitions and consumers? From what > I've read and experimented with, the number of partitions limits the number > of active consumers in a given consumer group on a given topic. So if the > number of partitions is 10, and the number of consumers is 12 (all in the > same group), 2 consumers will not receive any data unless one of the active > consumers dies. Is this correct? Is there a way that you can have more > consumers than partitions? > > Thanks! > > > Michael Golowka