Re: LeaderElectionNotNeededException

2020-10-15 Thread Liam Clarke-Hutchinson
And to follow up on this, we rolled one of the 41% brokers, partition leadership was redistributed to other brokers, but a preferred leader election immediately led to the exact same distribution. What's worse, is both of the 41% leadership brokers are in the same rack. Very keen for advice, or i

LeaderElectionNotNeededException

2020-10-15 Thread Liam Clarke-Hutchinson
Kia ora, I am rather bemused by this one, I'll admit. Kafka version 2.4.0. We've been migrating topic-partitions from old broker machines to new brokers, have redistributed replicas evenly across the new brokers, removed the old brokers, and tried to run a preferred leader election. And when I di

Kafka Streams application stuck rebalancing on startup

2020-10-15 Thread Alex Jablonski
Hey there! My team and I have run across a bit of a jam in our application where, given a particular setup, our Kafka Streams application never seems to start successfully, instead just getting stuck in the REBALANCING state. We've been able to get the crucial factors that cause this behavior down

Re: How to set consumer.overrides.auto.offset.reset as latest in MM2 ?

2020-10-15 Thread Yu Watanabe
Hello. Since my environment uses kafka 2.4.0 , I got over the situation by replacing the connec-mirror-2.4.0.jar with a new file in MM2 . Below are notes for what I have done. I am not sure if this is the right approach but would like to share it. 1.Having below offset in my source kafka cluster,