Re: Running the JobManager and TaskManager on the same node in a cluster

2016-11-19 Thread Robert Metzger
Hi Dominik, Your observation is right, running the JobManager and TaskManager on the same node is no problem. If that machine fails, both services will be affected, but as long as you have infrastructure in place (YARN for example) to start them somewhere else, nothing bad will happen. Regarding

Running the JobManager and TaskManager on the same node in a cluster

2016-11-16 Thread Dominik Safaric
Hi, It is generally recommended for streaming engines, also including Flink to run a separate master node - in the case of Flink, the JobManager. However, why should one in Flink run the JobManager on a separate node? Performance wise, the JobManager isn’t intense unlike of course TaskManager