Hi,
Currently, Flink does not support automatic scaling of the YARN containers.
There are certainly plans to add this feature:
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/add-some-new-api-to-the-scheduler-in-the-job-manager-tp7153p7448.html
Adding an API for manually starting a
Hi,
I have started a Flink YARN session using yarn-session.sh and the configuration
of number of YARN container seems to be pretty static.
Is it possible to have Flink adjust the number of containers depending on the
actual workload. E.g. stop containers that are idle for too long and start the
