Re: Leader election strategy

2022-11-15 Thread Mikhail Dubrovin
Hi Pierre, You may try to use cruise control: https://github.com/linkedin/cruise-control I didn't try it yet but it has task which may help you to auto-balance partitions in the cluster. BR, Mikhail On Tue, Nov 15, 2022 at 3:17 PM sunil chaudhari wrote: > Hi, > Use confluent. It has auto bala

Copy data from source cluster to target with different number of partitions

2022-09-26 Thread Mikhail Dubrovin
Hi, We have a cluster with topics that contain many partitions. We are going to decrease the number of partitions and looking for any solution. I t would be very useful to make it with MirrorMaker 2 but as we can see, it doesn't allow us to do it. MM2 creates missing partitions for a topic, e.g. s

Mirror Maker: copy data from source cluster to target with different number of partitions

2022-09-26 Thread Mikhail Dubrovin
We have a cluster with topics that contain many partitions. We are going to decrease the number of partitions and looking for any solution. I t would be very useful to make it with MirrorMaker 2 but as we can see, it doesn't allow us to do it. MM2 creates missing partitions for a topic, e.g. source