Re: The motive to detach new consumer and zookeeper

2015-12-07 Thread Jason Gustafson
Hi Li, I think reducing the client's complexity and improving performance were two of the main reasons for the change. The rebalance protocol on top of Zookeeper was difficult to implement correctly, and I think a number of Kafka clients never actually got it working. Removing it as a dependence a

The motive to detach new consumer and zookeeper

2015-12-05 Thread Li Tao
Hi guys, As we know, the new consumer of 0.9 kafka does not need to communicate with zookeeper. What is the motive / rational behind this disign? I have some guesses(correct me if i am wrong): 1. Reduce the complexity of consumer. It's hard to maintain the connections and states of kafka servers