Well, you're right. But that's not what I meant. I meant using consumers
with the same consumer id. With different IDs, obviously the problem (and
solution) changes. But then I think the OP is just trying to twist his
problem to fit in the kafka way of things.
--
Sharninder
On Sat, Aug 8, 2015 a
That's not true Shaninder. Assuming you are using the high level consumer,
if all the consumers have different group id, each of them will get the all
the messages.
Also, another way to think about this a little bit is that maybe you can
produce the same data to many different topics each have one
I don't know of any limits as such but I don't think your problem is suitable
for Kafka. The third point especially wouldn't work with Kafka. Using Kafka,
only one consumer will get a message out of the 30k
> On 03-Aug-2015, at 10:39 am, Vaibhav Kirte wrote:
>
> Hi,
>
> I need to know how m
I don't know a specific limit for number of consumers, perhaps someone will
have better idea.
Do note that with a single topic and a single partition, you can't really
scale by adding more machines - the way Kafka is currently designed, all
consumers will read from the one machine that has the lea
Hey Valibhav,
With only one partition, all of the consumers will end up hitting a single
broker (since partitions cannot be split). Whether it is possible to get
that number of consumers on a single broker may depend on the message load
through the topic. I think there has been some interest in al
Hi,
I need to know how many consumers can subscribe to a single topic ( with
one partition ).
I have a requirement such that,
1. The producer will post to 1 topic having 1 partition.
1. *20,000-30,000 consumers *should to be able to consume messages.
2. All of the consumers should rec
