Well, you're right. But that's not what I meant. I meant using consumers
with the same consumer id. With different IDs, obviously the problem (and
solution) changes. But then I think the OP is just trying to twist his
problem to fit in the kafka way of things.

--
Sharninder


On Sat, Aug 8, 2015 at 10:36 PM, Jiangjie Qin <j...@linkedin.com.invalid>
wrote:

> That's not true Shaninder. Assuming you are using the high level consumer,
> if all the consumers have different group id, each of them will get the all
> the messages.
>
> Also, another way to think about this a little bit is that maybe you can
> produce the same data to many different topics each have one partition, so
> the consumers needs only to consume from one of the topic.
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> On Mon, Aug 3, 2015 at 10:40 AM, Sharninder <sharnin...@gmail.com> wrote:
>
> > I don't know of any limits as such but I don't think your problem is
> > suitable for Kafka. The third point especially wouldn't work with Kafka.
> > Using Kafka, only one consumer will get a message out of the 30k
> >
> >
> >
> > > On 03-Aug-2015, at 10:39 am, Vaibhav Kirte <vaibhav.ki...@sokrati.com>
> > wrote:
> > >
> > > Hi,
> > >
> > > I need to know how many consumers can subscribe to a single topic (
> with
> > > one partition ).
> > >
> > > I have a requirement such that,
> > >    1. The producer will post to 1 topic having 1 partition.
> > >    1. *20,000-30,000 consumers *should to be able to consume messages.
> > >    2. All of the consumers should receive all messages that are
> produced.
> > >
> > > will this be possible using kafka ?
> > > is there a limit on number of consumers ?
> > > what will be the number of machines that I will need to satisfy the
> > > requirements ?
> > >
> > > --
> > > Regards,
> > > Vaibhav Kirte
> >
>



-- 
--
Sharninder

Reply via email to