Re: Limit max cpu usage per TaskManager

2019-11-09 Thread Rong Rong
1] to it to prevent too many operator >>>> threads running in the same TM. >>>> >>>> Hope this will be helpful😊 >>>> >>>> >>>> >>>> [1]. >>>> https://ci.apache.org/projects/flink/flink-docs-stable/dev/stre

Re: Limit max cpu usage per TaskManager

2019-11-08 Thread Yang Wang
a unique slot sharing group name [1] to it to prevent too many operator >>> threads running in the same TM. >>> >>> Hope this will be helpful😊 >>> >>> >>> >>> [1]. >>> https://ci.apache.org/projects/flink/flink-docs-stable/dev

Re: Limit max cpu usage per TaskManager

2019-11-06 Thread Lu Niu
1]. >> https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/#task-chaining-and-resource-groups >> >> >> >> Best, >> >> Victor >> >> >> >> *From: *Vino Yang >> *Date: *Wednesday, 6 November 2019 at 4:26 PM >&g

Re: Limit max cpu usage per TaskManager

2019-11-06 Thread Yang Wang
pful😊 > > > > [1]. > https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/#task-chaining-and-resource-groups > > > > Best, > > Victor > > > > *From: *Vino Yang > *Date: *Wednesday, 6 November 2019 at 4:26 PM > *To: *Lu Niu &g

Re: Limit max cpu usage per TaskManager

2019-11-06 Thread Victor Wong
/operators/#task-chaining-and-resource-groups Best, Victor From: Vino Yang Date: Wednesday, 6 November 2019 at 4:26 PM To: Lu Niu Cc: user Subject: Re: Limit max cpu usage per TaskManager Hi Lu, When using Flink on YARN, it will rely on YARN's resource management capabilities, and Flink c

Re: Limit max cpu usage per TaskManager

2019-11-06 Thread vino yang
Hi Lu, When using Flink on YARN, it will rely on YARN's resource management capabilities, and Flink cannot currently limit CPU usage. Also, what version of Flink do you use? As far as I know, since Flink 1.8, the -yn parameter will not work. Best, Vino Lu Niu 于2019年11月6日周三 下午1:29写道: > Hi, > >

Limit max cpu usage per TaskManager

2019-11-05 Thread Lu Niu
Hi, When run flink application in yarn mode, is there a way to limit maximum cpu usage per TaskManager? I tried this application with just source and sink operator. parallelism of source is 60 and parallelism of sink is 1. When running in default config, there are 60 TaskManager assigned. I notic