Re: Re-Balancing Kafka topics - Best practices

2017-06-15 Thread Abhimanyu Nagrath
Hi Tod, I am not able to access the link https://github.com/linkedin/kafka-toolskafka-assigner Regards, Abhimanyu On Fri, Jun 16, 2017 at 12:26 AM, karan alang wrote: > Thanks Todd.. for the detailed reply. > > regds, > Karan Alang > > On Tue, Jun 13, 2017 at 3:19 PM, Todd Palino wrote: > >

Re: Re-Balancing Kafka topics - Best practices

2017-06-15 Thread karan alang
Thanks Todd.. for the detailed reply. regds, Karan Alang On Tue, Jun 13, 2017 at 3:19 PM, Todd Palino wrote: > A few things here… > > 1) auto.leader.rebalance.enable can have serious performance impacts on > larger clusters. It’s currently in need of some development work to enable > it to batc

Re: Re-Balancing Kafka topics - Best practices

2017-06-13 Thread Todd Palino
A few things here… 1) auto.leader.rebalance.enable can have serious performance impacts on larger clusters. It’s currently in need of some development work to enable it to batch leader elections into smaller groups and back off between them, as well as have a better backoff after broker startup. I

Re-Balancing Kafka topics - Best practices

2017-06-13 Thread karan alang
Hi All, Fpr Re-balancing Kafka partitions, we can set property -> *auto.leader.rebalance.enable = true in server.properties file.* *Is that the recommended way or is it better to reBalance the kafka partitions manually ?(using *scripts - *kafka-preferred-replica-election.sh, * *kafka-reassign-