Hi Pierre,
You may try to use cruise control:
https://github.com/linkedin/cruise-control
I didn't try it yet but it has task which may help you to auto-balance
partitions in the cluster.
BR,
Mikhail
On Tue, Nov 15, 2022 at 3:17 PM sunil chaudhari
wrote:
> Hi,
> Use confluent. It has auto bala
Hi,
Use confluent. It has auto balancing feature.
You dont need to do these manual things.
On Tue, 15 Nov 2022 at 7:22 PM, Pierre Coquentin
wrote:
> Hello Luke, and thank you for your answer.
> What I would have hoped for is something more automatic, something that
> will spread the load when a
Hello Luke, and thank you for your answer.
What I would have hoped for is something more automatic, something that
will spread the load when a Kafka broker goes down without any human
intervention. The reassign script is a bit complicated, you need to
generate the topics and partitions list, then g
Hi Pierre,
Try using kafka-reassign-partitions.sh to reassign partitions to different
replicas you like.
ref: https://kafka.apache.org/documentation/#basic_ops_automigrate
Luke
On Mon, Nov 14, 2022 at 3:55 PM Pierre Coquentin
wrote:
> Hello,
> We have a Kafka cluster (2.4.1) with a replicatio
Hello,
We have a Kafka cluster (2.4.1) with a replication factor of 3. I notice
when we stop a broker that only one broker takes all the load from the
missing broker and becomes the leader to all partitions.
I would have thought that Kafka would split the load evenly among the
remaining brokers.
S
