Well, you're right. But that's not what I meant. I meant using consumers with the same consumer id. With different IDs, obviously the problem (and solution) changes. But then I think the OP is just trying to twist his problem to fit in the kafka way of things.
-- Sharninder On Sat, Aug 8, 2015 at 10:36 PM, Jiangjie Qin <j...@linkedin.com.invalid> wrote: > That's not true Shaninder. Assuming you are using the high level consumer, > if all the consumers have different group id, each of them will get the all > the messages. > > Also, another way to think about this a little bit is that maybe you can > produce the same data to many different topics each have one partition, so > the consumers needs only to consume from one of the topic. > > Thanks, > > Jiangjie (Becket) Qin > > On Mon, Aug 3, 2015 at 10:40 AM, Sharninder <sharnin...@gmail.com> wrote: > > > I don't know of any limits as such but I don't think your problem is > > suitable for Kafka. The third point especially wouldn't work with Kafka. > > Using Kafka, only one consumer will get a message out of the 30k > > > > > > > > > On 03-Aug-2015, at 10:39 am, Vaibhav Kirte <vaibhav.ki...@sokrati.com> > > wrote: > > > > > > Hi, > > > > > > I need to know how many consumers can subscribe to a single topic ( > with > > > one partition ). > > > > > > I have a requirement such that, > > > 1. The producer will post to 1 topic having 1 partition. > > > 1. *20,000-30,000 consumers *should to be able to consume messages. > > > 2. All of the consumers should receive all messages that are > produced. > > > > > > will this be possible using kafka ? > > > is there a limit on number of consumers ? > > > what will be the number of machines that I will need to satisfy the > > > requirements ? > > > > > > -- > > > Regards, > > > Vaibhav Kirte > > > -- -- Sharninder
