Re: Flink standalone cluster load average is too high.

2018-09-29 Thread weilongxing
It works. Thanks. > 在 2018年9月29日,下午2:14,Congxian Qiu 写道: > > Hi > In my opinion, you can use jstack to find what are the processes doing, If > you still have problem after that, you could share the code or some demo code > you are running. > > weilongxing mailto:we

Flink standalone cluster load average is too high.

2018-09-28 Thread weilongxing
I am using flink 1.5.2 in standalone mode. The machine is 8 cores with 32GB memory. I set slots to 4 or 8. I set most jobs parallelism to 1. And each machine has jobs less than the slot number. The load average is too high as the picture shows below. Each line presents load average 1 on one mac

Re: Which mode to choose flink on Yarn.

2018-09-19 Thread weilongxing
gt; This will allow the Job to be more fine-grained, and the refactoring of > Flink's FLIP-6-based deployment model tends to be "single job" mode. > But it will start more JM (appmaster) and take up more resources. > But in the end, how to choose also requires you to evalua

Re: Which mode to choose flink on Yarn.

2018-09-19 Thread weilongxing
ob to be more fine-grained, and the refactoring of > Flink's FLIP-6-based deployment model tends to be "single job" mode. > But it will start more JM (appmaster) and take up more resources. > But in the end, how to choose also requires you to evaluate and weigh. > > T

Which mode to choose flink on Yarn.

2018-09-19 Thread weilongxing
There are two methods to deploy flink applications on yarn. The first one is use yarn-session and all flink applications are deployed in the session. The second method is each flink application deploy on yarn as a yarn application. My question is what's the difference between these two methods?