We¹ve got a script that rebalances the partitions in a cluster based on their size (to try and keep the data size across the brokers even), which works very well for moving partitions onto new cluster members. The only problem with it is that it¹s got a couple hooks into our internal configuration system. We want to release it into the wild, but we need to fix that first so that the config it takes in is generic.
I¹ll bug the SRE that wrote it to see if we can get that done sooner than later. Especially since we just talked about it at ApacheCon and said we would :) -Todd On 4/23/14, 7:37 PM, "Drew Goya" <d...@gradientx.com> wrote: >Hey all, do you guys have any plans to enhance the topic reassignment >tool? > I've had to grow my cluster a couple times and getting an existing topics >partition replicas balanced out to the new brokers really sucks. I have >to >describe the topic, awk the output to get it in the json format, then >manually edit that file. > >If no one takes a crack at it by the time I've got to expand my cluster >gain I'll probably give it a shot but hopefully it is already in the >works!
