Re: automatic producer balancing over brokers

2012-12-28 Thread Jun Rao
This is a known bug in Kafka 0.7.x. Basically, for a new topic, we bootstrap using all existing brokers. However, if a topic already exists on some brokers, we never bootstrap again, which means new brokers will be ignored. For now, you have to manually create the topic on the new brokers (e.g., by

automatic producer balancing over brokers

2012-12-28 Thread Samuel García Martínez
Hi! I'm playing with kafka 0.7.2 using the following setup: 3 zk nodes ensemble 2 brokers: * num_partitions:3 * topic.partition.count.map=test-topic:5 My producer connects to brokers using "zk.connect" property. When the producer sends messages to the "test-topic" topic, the partitions are