Re: questions about yarn container（taskmanager）memory allocation

Hi XiangWei, Thank you for the inputs. I agree with you that it is possible that containers may use extra memory in 1.8. As for native memory, it is memory used by JVM and other processes outside JVM. So it's not limited by MaxDirectMemorySize. The community is working on a refactoring plan about

questions about yarn container（taskmanager）memory allocation

Hi all, Currently i am running my flink application in yarn session mode and using below commnad : *bin/yarn-session.sh -d -s 3 -jm 1024 -tm 4096* when taskmanager complete to started,i found the container launching command is : * bin/java -Xms2765m -Xmx2765m -XX:MaxDirectMemorySize=1331m .

Re: questions about YARN deployment and HDFS integration

Thanks for your answers :) Best regards/祝好, Chang Liu 刘畅 > On 17 Sep 2018, at 17:25, Kostas Kloudas wrote: > > Hi Chiang, > > Some of the answers you can find in line: > >> On Sep 17, 2018, at 3:47 PM, Chang Liu > > wrote: >> >> Dear All, >> >> I am helping my

Re: questions about YARN deployment and HDFS integration

Hi Chiang, Some of the answers you can find in line: > On Sep 17, 2018, at 3:47 PM, Chang Liu wrote: > > Dear All, > > I am helping my team setup a Flink cluster and we would like to have high > availability and easy to scale. > > We would like to setup a minimal cluster environment but can

Re: about yarn

Hi, All Thanks, JinKui Shi, have told the answer, just add -d is ok 2017-04-26 14:16 GMT+08:00 lining jing : > Hi, all > > I use /bin/flink run -m yarn-cluster > commit my flink job. But, after this, the process which name is CliFrontend > is running. After a duration, there are many CliFronten

about yarn

Hi, all I use /bin/flink run -m yarn-cluster commit my flink job. But, after this, the process which name is CliFrontend is running. After a duration, there are many CliFrontend run in my computer which is no need. Has any good idea soft this solution. Thanks!