We've built tools on top of it that both build the list based on less information (like "clone this broker to that one") and break it down into a configurable number of discrete moves so it doesn't tank the cluster.
And yes, I've finally started the process of departing them from the LinkedIn-specific tooling so we can release them to everyone else :) -Todd > On May 24, 2015, at 7:45 PM, Henry Cai <h...@pinterest.com.INVALID> wrote: > > We have a kafka cluster with 10 brokers and we are using the kafka > replication tool (kafka-reassign-partitions.sh) when we need to add more > brokers to the cluster. But this tool tends to move too many > topic/partitions around at the same time which causes instability. Do we > have an option to do it more slowly (e.g. move one topic/partition at a > step) or did some one build a tool on top of 'kafka-reassign-partitions.sh'? > > Another use case is when a broker node went down, do we have a tool to move > the topic/partitions serviced by this node to the remaining nodes (and > doing that in a fashion which doesn't cause too much instability)?
