Replication factor should not be a problem, only lead is used for writes and reads.
I'd monitor consumer offsets of all consumers of that topic - to make sure groupid is really same. Another thing could be that sarama client is simple, not implementing high level consumer like locking that only one consumer at a time is assigned to read from given partition. Kind regards, Stevo Slavic. On Tue, Jun 14, 2016 at 2:29 PM, Al-Isawi Rami <rami.al-is...@comptel.com> wrote: > Thanks, I forgot to mention that all my consumers (sarama go consumer) > have the same groupid. And I would like the “starvation” to happen to 2 of > my 3 consumers. and yes my topic really have single partition. > > I am getting unique message to each consumer. > > So somehow all three consumers are sharing one partition. Does it effect > that I have replication factor of 3? > > I am just puzzled what could be the reason. Any pointers? > > Regards, > -Rami > > > > > > On 14 Jun 2016, at 14:18, Jan Omar <jan.o...@wooga.net> wrote: > > > > > > Hi Rami, > > > > Each consumer will receive every single message if they belong to > different consumer groups. Messages will only be distributed between > consumers of the same consumer group. > > > > So make sure they are in the same consumer group, beware in your case > this means 2 of the 3 consumers will be starving. To solve this issue you > need to increase your partition count. > > > > Regards > > > > Jan > > > >> On 14 Jun 2016, at 13:07, Joris Peeters <j.peet...@wintoncapital.com> > wrote: > >> > >> I suppose the consumers would also need to all belong to the same > consumer group for your expectation to hold. If the three consumers belong > to different consumer groups, I'd expect each of them to receive all the > messages, regardless of the number of partitions. > >> So perhaps they are on different consumer groups? What client are you > using? > >> > >> -----Original Message----- > >> From: thinking [mailto:letianyi...@qq.com] > >> Sent: 14 June 2016 12:04 > >> To: users <users@kafka.apache.org> > >> Subject: Re: Three consumers on a single partition > >> > >> hi, > >> 1. you should check, if your topic partition really have one. > >> 2. does your consumer get same message or different message. > >> e.x all message is 1,2,3,4,5,6,7. consumer1 get 1,3,7 consumer2 get > 2,6, consumer3 get 4,5? > >> > >> > >> > >> > >> ------------------ Original ------------------ > >> From: "Al-Isawi Rami";<rami.al-is...@comptel.com>; > >> Date: Tue, Jun 14, 2016 06:58 PM > >> To: "users@kafka.apache.org"<users@kafka.apache.org>; > >> > >> Subject: Three consumers on a single partition > >> > >> > >> > >> Hi, > >> > >> I have a cluster of 3 brokers and 1 topic which has 1 partition and > replication factor of 3. There are also 3 consumers consuming from that > topic. > >> > >> Now all the docs I have seen say that if number of consumers is bigger > than the number of partition ( like in my case 3 consumers 1 partition), > then only one consumer will get messages and the other two will not get > any, nonetheless, they are all connected. > >> > >> However, in my case, all the three consumers are getting messages. Any > ideas why this is happening? > >> > >> Regards, > >> -Rami > >> Disclaimer: This message and any attachments thereto are intended > solely for the addressed recipient(s) and may contain confidential > information. If you are not the intended recipient, please notify the > sender by reply e-mail and delete the e-mail (including any attachments > thereto) without producing, distributing or retaining any copies thereof. > Any review, dissemination or other use of, or taking of any action in > reliance upon, this information by persons or entities other than the > intended recipient(s) is prohibited. Thank you. > >> > >> > >> Winton Capital Management Limited (“Winton”) is a limited company > registered in England and Wales with its registered offices at 16 Old > Bailey, London, EC4M 7EG (Registered Company No. 3311531). Winton is > authorised and regulated by the Financial Conduct Authority in the United > Kingdom, registered as an investment adviser with the US Securities and > Exchange Commission, registered with the US Commodity Futures Trading > Commission and a member of the National Futures Association in the United > States. > >> > >> This communication, including any attachments, is confidential and may > be privileged. This email is for use by the intended recipient only. If you > receive it in error, please notify the sender and delete it. You should not > copy or disclose all or any part of this email. > >> > >> This email does not constitute an offer or solicitation and nothing > contained in this email constitutes, and should not be construed as, > investment advice. Prospective investors should request offering materials > and consult their own advisers with respect to investment decisions and > inform themselves as to applicable legal requirements, exchange control > regulations and taxes in the countries of their citizenship, residence or > domicile. Past performance is not indicative of future results. > >> > >> Winton takes reasonable steps to ensure the accuracy and integrity of > its communications, including emails. However Winton accepts no liability > for any materials transmitted. Emails are not secure and cannot be > guaranteed to be error free. Winton handles personal information in > accordance with its privacy notice.< > https://www.wintoncapital.com/en/regulatory-disclosures#privacypolicy> > > > > Disclaimer: This message and any attachments thereto are intended solely > for the addressed recipient(s) and may contain confidential information. If > you are not the intended recipient, please notify the sender by reply > e-mail and delete the e-mail (including any attachments thereto) without > producing, distributing or retaining any copies thereof. Any review, > dissemination or other use of, or taking of any action in reliance upon, > this information by persons or entities other than the intended > recipient(s) is prohibited. Thank you. >
