Re: kafka topic information

2015-03-09 Thread Yuheng Du
Thanks, got it! best, Yuheng On Mon, Mar 9, 2015 at 11:52 AM, Harsha wrote: > In general users are expected to run zookeeper cluster of 3 or 5 nodes. > Zookeeper requires quorum of servers running which means at least ceil(n/2) > servers need to be up. For 3 zookeeper nodes there needs to be at

Re: kafka topic information

2015-03-09 Thread Harsha
In general users are expected to run zookeeper cluster of 3 or 5 nodes. Zookeeper requires quorum of servers running which means at least ceil(n/2) servers need to be up. For 3 zookeeper nodes there needs to be atleast 2 zk nodes up at any time , i.e your cluster can function  fine incase of 1 m

Re: kafka topic information

2015-03-09 Thread Yuheng Du
Harsha, Thanks for reply. So what if the zookeeper cluster fails? Will the topics information be lost? What fault-tolerant mechanism does zookeeper offer? best, On Mon, Mar 9, 2015 at 11:36 AM, Harsha wrote: > Yuheng, > kafka keeps cluster metadata in zookeeper along with topic > met

Re: kafka topic information

2015-03-09 Thread Harsha
Yuheng,           kafka keeps cluster metadata in zookeeper along with topic metadata as well. You can use zookeeper-shell.sh or zkCli.sh to check zk nodes, /brokers/topics will give you the list of topics . --  Harsha On March 9, 2015 at 8:20:59 AM, Yuheng Du (yuheng.du.h...@gmail.com) wrote:

kafka topic information

2015-03-09 Thread Yuheng Du
I am wondering where does kafka cluster keep the topic metadata (name, partition, replication, etc)? How does a server recover the topic's metadata and messages after restart and what data will be lost? Thanks for anyone to answer my questions. best, Yuheng