I don't know a specific limit for number of consumers, perhaps someone will have better idea.
Do note that with a single topic and a single partition, you can't really scale by adding more machines - the way Kafka is currently designed, all consumers will read from the one machine that has the leader for that partition. Can you share a bit more about why you have a requirement for 30K consumers with one partition? What's the specific use-case? Gwen On Sun, Aug 2, 2015 at 10:09 PM, Vaibhav Kirte <vaibhav.ki...@sokrati.com> wrote: > Hi, > > I need to know how many consumers can subscribe to a single topic ( with > one partition ). > > I have a requirement such that, > 1. The producer will post to 1 topic having 1 partition. > 1. *20,000-30,000 consumers *should to be able to consume messages. > 2. All of the consumers should receive all messages that are produced. > > will this be possible using kafka ? > is there a limit on number of consumers ? > what will be the number of machines that I will need to satisfy the > requirements ? > > -- > Regards, > Vaibhav Kirte >
