You are correct. The consumer threads will be rebalanced.
liuyiming@foxmail.com
From: rmka rmka
Date: 2015-03-19 14:12
To: users
Subject: High level consumer group
If you start first application with 3 threads (high level consumers) it’ll
consume all 6 partitions. When you start one more
If you start first application with 3 threads (high level consumers) it’ll
consume all 6 partitions. When you start one more application (same group
id) with 3 threads all consumers threads (6) will be rebalanced and each
thread will consume one partition.
Dzmitry
t boxes.
>>
>> If you want each application to handle all events for the topic, you
>> need to set a different group.id for each.
>>
>> On Mon, Mar 16, 2015 at 10:10 AM, sunil kalva
>> wrote:
>> > How do i deploy high level consumer group for one topic in mul
he topic, you
> need to set a different group.id for each.
>
> On Mon, Mar 16, 2015 at 10:10 AM, sunil kalva
> wrote:
> > How do i deploy high level consumer group for one topic in multiple
> > instances of consumer applications, i mean i have two consumer
> application
on to handle all events for the topic, you
need to set a different group.id for each.
On Mon, Mar 16, 2015 at 10:10 AM, sunil kalva wrote:
> How do i deploy high level consumer group for one topic in multiple
> instances of consumer applications, i mean i have two consumer applications
> d
How do i deploy high level consumer group for one topic in multiple
instances of consumer applications, i mean i have two consumer applications
deployed in two different boxes reading same topic which contains multiple
partitions. Can i achieve this ?
--
SunilKalva
If this is reproducible and you have logs that would help; in short
though, yes if you start up the replacement instance before the old
consumer instance's session is actually expired by zookeeper you could
run into rebalance exceptions (in which case you should see conflicts
in your consumer logs)
I'm working on some fault-tolerant consumer group. The idea is this, to
maximize the throughput of kafka. I request the metadata from broker and
create #{num of partition} consumers for each topic and distribute them on
different nodes. Moreover, there is mechanism to detect fail of any node
and re
Some of our tools use a consumer in Scala. You can take a look at
ConsoleConsumer or MirrorMaker.
Thanks,
Jun
On Fri, Jun 21, 2013 at 1:16 PM, Florin Trofin wrote:
> Hello Kafka wizards!
>
> Congratulations on achieving beta on the 0.8 release! We've been waiting
> too long for it!
> I have t
Hello Kafka wizards!
Congratulations on achieving beta on the 0.8 release! We've been waiting too
long for it!
I have two questions regarding the high level consumer in 0.8 used from scala:
I found this example on how to use the high level consumer from Java:
https://cwiki.apache.org/confluence
10 matches
Mail list logo
