Re: Job cluster and HA

2019-05-25 Thread Boris Lublinsky
I understand this. What I am not sure about is the sequence: It will come back and restore from ZK/HDFS And then it will try to start a job specified in the class, right? Which will overwrite (potentially) the restored job. How does it know not to start the job defined in the class, once the previo

Re: Job cluster and HA

2019-05-25 Thread bastien dine
Hello Boris, I think you are confused by the name of the shell script "standalone-job.sh" Which basically means that we start a "standalone job manager" as stated in the first comment of https://github.com/apache/flink/blob/release-1.8/flink-dist/src/main/flink-bin/bin/standalone-job.sh This is a

Job cluster and HA

2019-05-24 Thread Boris Lublinsky
Hi, I was experimenting with HA lately and see that it recovers successfully job, in the case of jobmanager restarts. Now my question is whether it will work for the job cluster. Based on the instructions https://github.com/apache/flink/blob/release-1.8/flink-container/docker/README.md