Re: auto leader rebalancing

2016-04-27 Thread Kane Kim
No, I don't see that in controller.log. Looks like it's related to this bug: https://issues.apache.org/jira/browse/KAFKA-2729, after I did rolling restart (all brokers) it rebalanced. It wasn't rebalancing though when a couple of brokers were missing from ISR (but there were enough brokers to rebal

Re: auto leader rebalancing

2016-04-27 Thread Robert Christ
I believe the 10% is measured on a broker level not a topic level. Do you see lines like: [2016-04-27 22:52:47,854] TRACE [Controller 3]: leader imbalance ratio for broker 5 is 0.978555 (kafka.controller.KafkaController) [2016-04-27 22:52:47,855] TRACE [Controller 3]: leader imbalance ratio for

Re: auto leader rebalancing

2016-04-27 Thread Kane Kim
Bump On Tue, Apr 26, 2016 at 10:33 AM, Kane Kim wrote: > Hello, > > We have auto.leader.rebalance.enable = True, other options are by default > (10% imbalance ratio and 300 seconds). > > We have a check that reports leadership imbalance: > > critical: Leadership out of balance for topic mp-auth.