Re: Clustered Kafka/Zookeeper setup not rebalancing all partitions

2013-04-23 Thread Jun Rao
Could you run the tool kafka.tools.ConsumerOffsetChecker? It will show you which consumer instance owns which partition. Thanks, Jun On Tue, Apr 23, 2013 at 12:12 AM, Karl Kirch wrote: > Our setup is a three node cluster, we have a Kafka 0.7.2 (with 10 > partitions per node) and Zookeeper 3.3

Clustered Kafka/Zookeeper setup not rebalancing all partitions

2013-04-23 Thread Karl Kirch
Our setup is a three node cluster, we have a Kafka 0.7.2 (with 10 partitions per node) and Zookeeper 3.3.4 on each node. When we first start up the cluster, there are no issues and things work just fine, but after a while things start acting a bit haywire. It looks like we start to miss messages