Re: Flink HA mode

2015-09-10 Thread Ufuk Celebi
done yet. > > Best, Fabian > On Sep 10, 2015 01:29, "Emmanuel" wrote: > >> is this a 0.10 snapshot feature only? I'm using 0.9.1 right now >> >> >> ------ >> From: ele...@msn.com >> To: user@flink.apache.org >&g

RE: Flink HA mode

2015-09-09 Thread Fabian Hueske
ng 0.9.1 right now > > > -- > From: ele...@msn.com > To: user@flink.apache.org > Subject: RE: Flink HA mode > Date: Wed, 9 Sep 2015 16:11:38 -0700 > > Been playing with the HA... > I find the UIs confusing here: > in the dashboard on one side I see 0 slots 0 taskmanag

RE: Flink HA mode

2015-09-09 Thread Emmanuel
is this a 0.10 snapshot feature only? I'm using 0.9.1 right now From: ele...@msn.com To: user@flink.apache.org Subject: RE: Flink HA mode Date: Wed, 9 Sep 2015 16:11:38 -0700 Been playing with the HA...I find the UIs confusing here: in the dashboard on one side I see 0 slots 0 taskman

RE: Flink HA mode

2015-09-09 Thread Emmanuel
e multiple JMs IPs in the jobmanager.rpc.address? Thanks Date: Wed, 9 Sep 2015 10:19:36 +0200 Subject: Re: Flink HA mode From: trohrm...@apache.org To: user@flink.apache.org The only necessary information for the JobManager and TaskManager is to know where to find the ZooKeeper quorum to do leader election

Re: Flink HA mode

2015-09-09 Thread Till Rohrmann
The only necessary information for the JobManager and TaskManager is to know where to find the ZooKeeper quorum to do leader election and retrieve the leader address from. This will be configured via the config parameter `ha.zookeeper.quorum`. On Wed, Sep 9, 2015 at 10:15 AM, Stephan Ewen wrote:

Re: Flink HA mode

2015-09-09 Thread Stephan Ewen
TL;DR is that you are right, it is only the initial list. If a JobManager comes back with a new IP address, it will be available. On Wed, Sep 9, 2015 at 8:35 AM, Ufuk Celebi wrote: > > > On 09 Sep 2015, at 04:48, Emmanuel wrote: > > > > my questions is: how critical is the bootstrap ip list in

Re: Flink HA mode

2015-09-08 Thread Ufuk Celebi
> On 09 Sep 2015, at 04:48, Emmanuel wrote: > > my questions is: how critical is the bootstrap ip list in masters? Hey Emmanuel, good questions. I read over the docs for this again [1] and you are right that we should make this clearer. The “masters" file is only relevant for the start/stop

RE: Flink HA mode

2015-09-08 Thread Emmanuel
my questions is: how critical is the bootstrap ip list in masters? does this get updated or does it have to be updated by some other service? From: zhangruc...@huawei.com To: user@flink.apache.org Subject: re: Flink HA mode Date: Wed, 9 Sep 2015 00:48:42 + In order to discover new

re: Flink HA mode

2015-09-08 Thread Zhangrucong
In order to discover new JM,I think must use ZK. ZK has the ability to find a new node or the content of node changed. First JM must create node in ZK, and write IP and port in node. TMs watch this node. When TMs find the node content change, TMs reconnect the new JM. Thanks. 发件人: Emmanuel [mai