RE: Multiple consumer groups with same group id on a single topic

2015-03-10 Thread Phill Tomlinson
tition. I re-wrote the producer to use the new API and target set partitions and I can now see both consumer groups consuming from different partitions. Phill -Original Message----- From: Phill Tomlinson [mailto:philltomlin...@fico.com] Sent: 10 March 2015 08:18 To: users@kafka.apache.org S

RE: Multiple consumer groups with same group id on a single topic

2015-03-10 Thread Phill Tomlinson
ot;, messageWrapper)); } -Original Message- From: Kevin Scaldeferri [mailto:ke...@scaldeferri.com] Sent: 09 March 2015 18:13 To: users@kafka.apache.org Subject: Re: Multiple consumer groups with same group id on a single topic On Mon, Mar 9, 2015 at 10:38 AM, Phill Tomlinson wrote: > H

RE: Multiple consumer groups with same group id on a single topic

2015-03-09 Thread Phill Tomlinson
mentioned, what you can do is to run several > consumers on different physical machine with the same group id, they > will balance the partition among themselves if you are using high level > consumer. > > Jiangjie (Becket) Qin > > On 3/9/15, 1:27 AM, "Phill Tomlinson&quo

Multiple consumer groups with same group id on a single topic

2015-03-09 Thread Phill Tomlinson
Hi, I have a topic with 6 partitions. I have two consumer groups with 3 consumers each, both with the same group.id. However only one group appears to consume from the topic. Is this expected behaviour? I would expect to be able to concurrently use two consumer groups on the same topic to prov