Re: Zookeeper use cases with Kafka

2015-08-18 Thread Manikumar Reddy
Hi, 1. ZK is used for co-ordination between brokers, controller election, leader election, storing topic configuration etc. I think we use both sequential and ephemeral nodes. 2. Yes, Kafka uses ZK watches for controller changes, new topic creation, new partition creation, leader chan

Re: Zookeeper use cases with Kafka

2015-08-18 Thread Grant Henke
Hi Prabcs, Much of that information can be found in the documentation and on the wiki. The remaining can be found in the code. Any improvements to the documentation is not only welcome but encouraged. Below are a few links to get you started: Documentation (See "Zookeeper Directories"): http://ka

Zookeeper use cases with Kafka

2015-08-18 Thread Prabhjot Bharaj
Hello Folks, I wish to contribute to Kafka internals. And, one of the things which can help me do that is understanding how kafka uses zookeeper. I have some of these basic doubts:- 1. Is zookeeper primarily used for locking ? If yes, in what cases and what kind of nodes does it use - sequential/