When you start one application it will consume all 6 partitions - 2 partitions by each thread. When you later start the second app, the consumer will rebalance and allocate 3 partitions to the new application.
On Mon, Mar 16, 2015 at 10:59 AM, sunil kalva <sambarc...@gmail.com> wrote: > > Say for example i have a topic A with 6 partitions and two consumer > applications with 3 consumer threads each and with the same groupid. > If i start one application does it start consuming only 3 partitions, and if > start later the other one, does it start picking the rest of the partitions > ?. > or > If i start one application does it start consuming all 6 partitions, and if > start later the other one, does it start sharing the partitions with the > other application threads ? > > t > SunilKalva > > On Mon, Mar 16, 2015 at 10:48 PM, Gwen Shapira <gshap...@cloudera.com> > wrote: >> >> If you want each application to handle half of the partitions for the >> topic, you need to configure the same group.id for both applications. >> In this case, Kafka will just see each app as a consumer in the group >> and it won't care that they are on different boxes. >> >> If you want each application to handle all events for the topic, you >> need to set a different group.id for each. >> >> On Mon, Mar 16, 2015 at 10:10 AM, sunil kalva <sambarc...@gmail.com> >> wrote: >> > How do i deploy high level consumer group for one topic in multiple >> > instances of consumer applications, i mean i have two consumer >> > applications >> > deployed in two different boxes reading same topic which contains >> > multiple >> > partitions. Can i achieve this ? >> > >> > -- >> > SunilKalva > > > > > -- > SunilKalva
