Re: Extending Flink Slots when running on Yarn

2018-02-02 Thread Gary Yao
Hi Julio, When you start the Flink YARN session, you have to specify the number of TaskManagers and number of slots per TaskManager. There is currently no officially supported way to add more TaskManagers to a long running YARN session. We are aware of this limitation, and there are ongoing develo

Extending Flink Slots when running on Yarn

2018-02-01 Thread Julio Biason
Hi, I'm wodering, is there a way to make Flink understand that I added a new worker machine on yarn to increase the tasks slots? Right now, we are just exploring how to run Flink on Yarn and, so far, we managed to create a small Hadoop/Yarn cluster (3 machines, 1 master and 2 workers) and start F