Recovering Under Replicated Partitions

Hi all. I've got a cluster of 3 brokers with around 50 topics. Several topics are under replicated. Everything I've seen says I need to restart the followers to fix that. All my under replicated topics have the same broker as the leader. That makes me think it's a leader problem and not a

Cancel partition reassignment?

Hi all. I'm trying to cancel a failed partition reassignment. I've heard that this can be done by deleting /admin/reassign_partitions in zookeeper. I've tried and /admin/reassign_partitions won't go away. Does anyone know a way to cancel a partition reassignment? -Dylan (206) 855-9740 -

Completely clear out kafka brokers & zookeeper?

I have some boxes that I'm using to test kafka configurations (and zookeeper). What's the recommended procedure to clean them out to a clean state so I can re-install kafka and zookeeper without worrying about old data or configuration getting in the way? -Dylan (206) 855-9740 - Home (206)

Reduce number of brokers?

I have a cluster with 4 brokers and I want to reduce it to 2 brokers. I cannot re-assign __consumer_offsets because it wants at least 3 brokers. Is there a way to do this? Or am I going to have to trash my cluster and start over? -Dylan (206) 855-9740 - Home (206) 235-8809 - Cell The in

Is it possible to know the number of producers for a topic?

I have a situation where I should always have exactly one producer per topic, but under certain rare circumstances I can have more than one, and that's really bad when it happens, so I want to detect it. Can I know how many producer a topic has? Can I identify them? Thanks! -Dylan The infor

Confusingly unbalanced broker

Hi all! I have a cluster of about 20 brokers and one of them is transmitting about 4 times as much data as the others (80mB/sec vs 20mB/sec). It has the roughly the same number of topics & partitions and it's the leader for the same number as all the other brokers. The kafka-manager web tool

Fw: Confusingly unbalanced broker

need to figure out what that means. Thanks! -Dylan From: Alex Woolford Sent: Saturday, February 8, 2020 10:09 PM To: users@kafka.apache.org Cc: Dylan Martin Subject: Re: Confusingly unbalanced broker [EXTERNAL E-MAIL] That's a very intriguing quest

Why would all consumers pull from the same partition?

I have a cluster of 20'ish brokers. One topic has 60'ish consumers and 100 partitions, but the consumers all seem to be hitting the same broker, which makes me think they're all hitting the same partition. What would cause that? I assume I've configured something wrong. Thanks! -Dylan The i

Re: Why would all consumers pull from the same partition?

all consumers pull from the same partition? [EXTERNAL E-MAIL] Partition is decided based on message record key. If it's same, it will hit the same partition. -Original Message- From: Dylan Martin Sent: Monday, February 10, 2020 12:35 PM To: users@kafka.apache.org Subject: Why woul