Fair enough. For one time task, we can probably use some manual work with
sprinkling of automation thrown in. I will look into cruise control.

Question: now that Kafka knows about "rack" future assignments should
strictly be zone aware, is that a correct assessment? IOW, if a partition
is thrown out and gets reassigned, the leader/replica will be in different
zones.

Thanks,

On Wed, Nov 20, 2024 at 3:22 PM Oleksandr Shulgin <
oleksandr.shul...@zalando.de> wrote:

> On Wed, Nov 20, 2024 at 9:15 AM Soham Chakraborty <dec.so...@gmail.com>
> wrote:
>
> >
> >  So my goal is to know whether there is any knob by which I can force the
> > leader and replica to go to different AZs and is there any automated
> > way/tool to handle this for existing partitions. In other words, I want
> the
> > leader and replica to be distributed across different AZs now and in
> > future.
> >
>
> Maybe a bit heavy-weight for a one-time task, but Cruise Control from
> LinkedIn does have rack-aware distribution goals that you can use to
> "rebalance" your existing replicas:
> https://github.com/linkedin/cruise-control
>
> Otherwise you can use kafka-reassign-partitions script to achieve the same
> result as a one-off task.
>
>
> Cheers,
> --
> Alex
>

Reply via email to