Hello All, Can you please help with the below :
I was reading up on Kafka 0.9 API version and came across the below : The following is a draft design that uses a high-available consumer coordinator at the broker side to handle consumer rebalance. By migrating the rebalance logic from the consumer to the coordinator we can resolve the consumer split brain problem and help thinner the consumer client. Please can you help with the below questions : I have a single topic with single consumer group id. There are 20 partitions. The consumer client is running on a single node which has 20 threads. We are using zookeeper to fetch messages from Kafka. 1) When using Kafka 0.8.2 API , how can re balancing be done? Can the same consumer project be deployed into multiple nodes and will zookeeper automatically do the rebalancing? 2) What are the changes that we need to take care of when upgrading to 0.9 API version? Should underlying Kafka installation be changed by itself or is it suffice to just use 0.9 consumer api? 3) Can zookeeper be completely eliminated when upgrading to 0.9 version? Thank You! Regards
