Re: Replace Flink job while cluster is down

2016-12-08 Thread Ufuk Celebi
With HA enabled, Flink checks the configured ZooKeeper node for pre-existing jobs and checkpoints when starting. What Stefan meant was that you can configure a different ZooKeeper node, which will start the cluster with a clean state. You can check the available config options here:  https://ci

Re: Replace Flink job while cluster is down

2016-12-08 Thread Al-Isawi Rami
Hi Stefan, Yes, a cluster of 3 machines. Version 1.1.1 I did not get what is the difference between “remove entry from zookeeper” and “using flink zookeeper namespaces feature”. Eventually, I started the cluster and it did recover the old program. However, I was fast enough to click Cancel in

Re: Replace Flink job while cluster is down

2016-12-07 Thread Stefan Richter
Hi, first a few quick questions: I assume you are running in HA mode, right? Also what version of Flink are you running? In case you are not running HA, nothing is automatically recovered. With HA, you would need to manually remove the corresponding entry from Zookeeper. If this is the problem

Replace Flink job while cluster is down

2016-12-07 Thread Al-Isawi Rami
Hi, I have faulty flink streaming program running on a cluster that is consuming from kafka,so I brought the cluster down. Now I have a new version that has the fix. Now if I bring up the flink cluster again, the old faulty program will be recovered and it will consume and stream faulty results