Re: High level consumer group

2015-03-19 Thread liuyiming....@foxmail.com
You are correct. The consumer threads will be rebalanced. liuyiming@foxmail.com From: rmka rmka Date: 2015-03-19 14:12 To: users Subject: High level consumer group If you start first application with 3 threads (high level consumers) it’ll consume all 6 partitions. When you start one more

Re: High level consumer group

2015-03-16 Thread Gwen Shapira
When you start one application it will consume all 6 partitions - 2 partitions by each thread. When you later start the second app, the consumer will rebalance and allocate 3 partitions to the new application. On Mon, Mar 16, 2015 at 10:59 AM, sunil kalva wrote: > > Say for example i have a top

Re: High level consumer group

2015-03-16 Thread sunil kalva
Say for example i have a topic A with 6 partitions and two consumer applications with 3 consumer threads each and with the same groupid. If i start one application does it start consuming only 3 partitions, and if start later the other one, does it start picking the rest of the partitions ?. or If

Re: High level consumer group

2015-03-16 Thread Gwen Shapira
If you want each application to handle half of the partitions for the topic, you need to configure the same group.id for both applications. In this case, Kafka will just see each app as a consumer in the group and it won't care that they are on different boxes. If you want each application to hand

Re: High level consumer group example in scala

2013-06-21 Thread Jun Rao
Some of our tools use a consumer in Scala. You can take a look at ConsoleConsumer or MirrorMaker. Thanks, Jun On Fri, Jun 21, 2013 at 1:16 PM, Florin Trofin wrote: > Hello Kafka wizards! > > Congratulations on achieving beta on the 0.8 release! We've been waiting > too long for it! > I have t