Re: keep-alive job strategy

2017-10-09 Thread Fabian Hueske
Hi Rob, yes, this behavior is expected. Flink does not automatically scale-down a job in case of a failure. You have to ensure that you have enough resources available to continue processing. In case of Flink's cluster mode, the common practice is to have stand-by TMs available (the same is true f

keep-alive job strategy

2017-10-06 Thread r. r.
Hello I have set up a cluster and added taskmanagers manually with bin/taskmanager.sh start. I noticed that if i have 5 task managers with one slot each and start a job with -p5, then if i stop a taskmanager the job will fail even if there are 4 more taskmanagers. Is this expected (I turned off