Re: High availability with zookeeper: worker discovery

2015-07-30 Thread Christophe Schmitz
a bit more detail on how the election / discovery of master > works ? > > Cheers > > On Thu, Jul 30, 2015 at 7:41 PM, Christophe Schmitz > wrote: > >> Hi there, >> >> I am trying to run a 3 node spark cluster where each nodes contains a >> spark worker and

High availability with zookeeper: worker discovery

2015-07-30 Thread Christophe Schmitz
Hi there, I am trying to run a 3 node spark cluster where each nodes contains a spark worker and a spark maser. Election of the master happens via zookeeper. The way I am configuring it is by (on each node) giving the IP:PORT of the local master to the local worker, and I wish the worker could au