Re: Producer can't initialize if zk host down (0.7.2)

2013-05-21 Thread Neha Narkhede
Right. Zookeeper has added the feature to allow dynamically reconfiguring zookeeper clusters, but it is part of zookeeper 3.5.0. Thanks, Neha On Tue, May 21, 2013 at 3:05 PM, Jason Rosenberg wrote: > Thanks Neha, > > I see now that is true. It looks like it just needs to resolve all the > hos

Re: Producer can't initialize if zk host down (0.7.2)

2013-05-21 Thread Jason Rosenberg
Thanks Neha, I see now that is true. It looks like it just needs to resolve all the hosts (but doesn't need zk to be available on each host). So decommissioning a zknode (and removing from dns) is a bit more sensitive than I thought. I can't think of any reason that zkClient should require this

Re: Producer can't initialize if zk host down (0.7.2)

2013-05-21 Thread Neha Narkhede
According to zookeeper code, when you try to create a client handle to zookeeper, it resolves each of the hosts in the zookeeper connection string. If any of these fail, it throws an exception. If you use a zookeeper based producer, it tries to create a ZkClient handle which in turn tries to create

Producer can't initialize if zk host down (0.7.2)

2013-05-21 Thread Jason Rosenberg
Hi, I am seeing an unexpected situation. My producers use a zkconnection string to connect to kafka (this is still 0.7.2). If one of the zk hosts is taken down and removed from dns, it causes an UnknownHostException, and the producer can't initialize. I expect this is different than the less se