Fair enough. For one time task, we can probably use some manual work with sprinkling of automation thrown in. I will look into cruise control.
Question: now that Kafka knows about "rack" future assignments should strictly be zone aware, is that a correct assessment? IOW, if a partition is thrown out and gets reassigned, the leader/replica will be in different zones. Thanks, On Wed, Nov 20, 2024 at 3:22 PM Oleksandr Shulgin < oleksandr.shul...@zalando.de> wrote: > On Wed, Nov 20, 2024 at 9:15 AM Soham Chakraborty <dec.so...@gmail.com> > wrote: > > > > > So my goal is to know whether there is any knob by which I can force the > > leader and replica to go to different AZs and is there any automated > > way/tool to handle this for existing partitions. In other words, I want > the > > leader and replica to be distributed across different AZs now and in > > future. > > > > Maybe a bit heavy-weight for a one-time task, but Cruise Control from > LinkedIn does have rack-aware distribution goals that you can use to > "rebalance" your existing replicas: > https://github.com/linkedin/cruise-control > > Otherwise you can use kafka-reassign-partitions script to achieve the same > result as a one-off task. > > > Cheers, > -- > Alex >
