Re: 答复: Best way to find the current alive jobmanager with HA mode zookeeper

2018-08-21 Thread Till Rohrmann
id notice there is webMonitorRetrievalService member in Flink >>>> 1.5. >>>> >>>> >>>> >>>> I wonder if I can use RestClusterClient@v1.5 on my client side, to >>>> retrieve the leader JM of Flink v1.4 Cluster. >>>> &

Re: 答复: Best way to find the current alive jobmanager with HA mode zookeeper

2018-08-21 Thread Martin Eden
rievalService member in Flink >>> 1.5. >>> >>> >>> >>> I wonder if I can use RestClusterClient@v1.5 on my client side, to >>> retrieve the leader JM of Flink v1.4 Cluster. >>> >>> >>> >>> Thanks >>> >&

Re: 答复: Best way to find the current alive jobmanager with HA mode zookeeper

2018-07-31 Thread Till Rohrmann
er JM of Flink v1.4 Cluster. >> >> >> >> Thanks >> >> Youjun >> >> >> >> *发件人**:* vino yang >> *发送时间:* Wednesday, July 25, 2018 7:11 PM >> *收件人:* Martin Eden >> *抄送:* Yuan,Youjun ; user@flink.apache.org >> *主题:* Re: Best

Re: 答复: Best way to find the current alive jobmanager with HA mode zookeeper

2018-07-25 Thread vino yang
018 7:11 PM > *收件人:* Martin Eden > *抄送:* Yuan,Youjun ; user@flink.apache.org > *主题:* Re: Best way to find the current alive jobmanager with HA mode > zookeeper > > > > Hi Martin, > > > > > > For a standalone cluster which exists multiple JM instances, If you

答复: Best way to find the current alive jobmanager with HA mode zookeeper

2018-07-25 Thread Yuan,Youjun
ent@v1.5> on my client side, to retrieve the leader JM of Flink v1.4 Cluster. Thanks Youjun 发件人: vino yang 发送时间: Wednesday, July 25, 2018 7:11 PM 收件人: Martin Eden 抄送: Yuan,Youjun ; user@flink.apache.org 主题: Re: Best way to find the current alive jobmanager with HA mode zookeeper Hi Martin,

Re: Best way to find the current alive jobmanager with HA mode zookeeper

2018-07-25 Thread vino yang
Hi Martin, For a standalone cluster which exists multiple JM instances, If you do not use Rest API, but use Flink provided Cluster client. The client can perceive which one this the JM leader from multiple JM instances. For example, you can use CLI to submit flink job in a non-Leader node. But

Re: Best way to find the current alive jobmanager with HA mode zookeeper

2018-07-25 Thread Martin Eden
Hi, This is actually very relevant to us as well. We want to deploy Flink 1.3.2 on a 3 node DCOS cluster. In the case of Mesos/DCOS, Flink HA runs only one JobManager which gets restarted on another node by Marathon in case of failure and re-load it's state from Zookeeper. Yuan I am guessing you

***UNCHECKED*** Re: Best way to find the current alive jobmanager with HA mode zookeeper

2018-07-24 Thread vino yang
Hi Yuan Youjun, Actually, RestClusterClient has a method named getWebMonitorBaseUrl which will retrieve the webmonitor's leader address when you submit job automatically.[1] Ideally, you do not need to retrieve JM by yourself. Currently, the webmonitor is binding with JobManager, maybe if JM fail

Best way to find the current alive jobmanager with HA mode zookeeper

2018-07-24 Thread Yuan,Youjun
Hi all, I have a standalone cluster with 3 jobmanagers, and set high-availability to zookeeper. Our client submits job by REST API(POST /jars/:jarid/run), which means we need to know the host of the any of the current alive jobmanagers. The problem is that, how can we know which job manager is