Hi,
AFAIK, the JobGraph itself is not stored in ZK but in HDFS. ZK only stores a
handle to the serialised JobGraph.
Best,
Aljoscha
> On 15. Feb 2018, at 04:59, Chirag Dewan wrote:
>
> Thanks a lot Aljoscha.
>
> I was doing a silly mistake. TaskManagers can now register with JobManager.
>
>
Thanks a lot Aljoscha.
I was doing a silly mistake. TaskManagers can now register with JobManager.
One more thing, does Flink now store Job Graphs on ZK too?
Regards,
Chirag
On Wednesday, 14 February, 2018, 8:06:14 PM IST, Aljoscha Krettek
wrote:
It should be roughly the same settings t
It should be roughly the same settings that you use in your JobManager. They
are described here:
https://ci.apache.org/projects/flink/flink-docs-master/ops/config.html#zookeeper-based-ha-mode
> On 14. Feb 2018, at 15:32, Chirag Dewan wrote:
>
> Thanks Aljoscha.
>
> I haven't checked that bit.
Thanks Aljoscha.
I haven't checked that bit. Is there any configuration for TaskManagers to find
ZK?
Regards,
Chirag
Sent from Yahoo Mail on Android
On Wed, 14 Feb 2018 at 7:43 PM, Aljoscha Krettek wrote:
Do you see in the logs whether the TaskManager correctly connect to ZooKeeper
as we
Do you see in the logs whether the TaskManager correctly connect to ZooKeeper
as well? They need this in order to find the JobManager leader.
Best,
Aljoscha
> On 14. Feb 2018, at 06:12, Chirag Dewan wrote:
>
> Hi,
>
> I am trying to deploy a Flink cluster (1 JM, 2TM) on a Docker Swarm. For
>
Hi,
I am trying to deploy a Flink cluster (1 JM, 2TM) on a Docker Swarm. For
JobManager HA, I have started a 3 node zookeeper service on the same swarm
network and configured Flink's zookeeper quorum with zookeeper service
instances.
JobManager gets started with the LeaderElectionService and ge
