That's not true Shaninder. Assuming you are using the high level consumer, if all the consumers have different group id, each of them will get the all the messages.
Also, another way to think about this a little bit is that maybe you can produce the same data to many different topics each have one partition, so the consumers needs only to consume from one of the topic. Thanks, Jiangjie (Becket) Qin On Mon, Aug 3, 2015 at 10:40 AM, Sharninder <sharnin...@gmail.com> wrote: > I don't know of any limits as such but I don't think your problem is > suitable for Kafka. The third point especially wouldn't work with Kafka. > Using Kafka, only one consumer will get a message out of the 30k > > > > > On 03-Aug-2015, at 10:39 am, Vaibhav Kirte <vaibhav.ki...@sokrati.com> > wrote: > > > > Hi, > > > > I need to know how many consumers can subscribe to a single topic ( with > > one partition ). > > > > I have a requirement such that, > > 1. The producer will post to 1 topic having 1 partition. > > 1. *20,000-30,000 consumers *should to be able to consume messages. > > 2. All of the consumers should receive all messages that are produced. > > > > will this be possible using kafka ? > > is there a limit on number of consumers ? > > what will be the number of machines that I will need to satisfy the > > requirements ? > > > > -- > > Regards, > > Vaibhav Kirte >
