Hi all! Here comes a pretty big FLIP: "Improvements to the Flink Deployment and Process Model", to better support Yarn, Mesos, Kubernetes, and whatever else Google, Elon Musk, and all the other folks will think up next.
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65147077 It is a pretty big FLIP where I took input and thoughts from many people, like Till, Max, Xiaowei (and his colleagues), Eron, and others. The core ideas revolve around - making the JobManager in its core a per-job component (handle multi tenancey outside the JobManager) - making resource acquisition and release more dynamic - tying deployments more naturally to jobs where desirable Let's get the discussion started... Greetings, Stephan