Re: Kafka work stealing question

Hi Alex, Thanks for getting back to me so quickly. What I conclude from your answer is that a consumer is only loyal to the partition it is glued to. It cannot steal work from other partitions. Is the understanding correct? Do we anticipate work stealing in any of the future releases ? Regards

Re: Kafka work stealing question

Hey Gagan, If there are more partitions than consumers in a group, some consumers are allocated multiple partitions. If there are no more messages for the partitions that have been allocated to a consumer, that consumer will continue to poll until messages show up in those partitions. It won't st

Kafka work stealing question

Hi team, If a consumer group has 5 subscribers to a topic which has 5 partitions, do the subscribers steal work if they are done with their own? Regards Gagan

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

Congrats, Matthias! On Sat, Apr 20, 2019 at 10:28 AM Matthias J. Sax wrote: > Thank you all! > > -Matthias > > > On 4/19/19 3:58 PM, Lei Chen wrote: > > Congratulations Matthias! Well deserved! > > > > -Lei > > > > On Fri, Apr 19, 2019 at 2:55 PM James Cheng > > wro

Re: NotEnoughReplicasException on __transaction_state after bring down one of kakfa broker

Thanks to Harper. The problem here was that why we lost the ISR? As we have a cluster with 7 nodes, and brought down 1 node. On 2019/04/19 21:06:10, Harper Henn wrote: > The docs indicate that exception is thrown when the "number of insync > replicas for the partition is lower than min.insync

Kafka broker impact with large number of consumer groups in parallel

Hi, I have some doubt regarding using kafka consumer API in kafka version 0.10.0.1. Consider I am having a three node kafka cluster in which there are 1000 topics with single partition. Each topic will be consumed by multiple consumer groups, say 100 in parallel. Therefore totally there can be 10