Re: Submitting Flink application on YARN parameter

2018-04-28 Thread Kien Truong
Hi, You have to enable CPU scheduling in YARN, otherwise it always shows that only 1 CPU is allocated for each container, regardless of how many Flink try to allocated. TaskManager memory is 1400MB, but Flink reserves some amount for for off-heap memory, so the actual heap size is smaller.

Submitting Flink application on YARN parameter

2018-04-28 Thread Soheil Pourbafrani
Hi, I have an Flink .jar file and I submit it on yarn cluster using the command: flink run -m yarn-cluster -yn 5 -yjm 768 -ytm 1400 -ys 2 -yqu streamQ my_program.jar According to the submitting command I expect: // It will create 5 containers > satisfied // each container should use 2 core -