Re: YarnResourceManager unresponsive under heavy containers allocations

2019-07-10 Thread qi luo
Got it, thank you! > On Jul 10, 2019, at 2:20 PM, Xintong Song wrote: > > Thanks for the kindly offer, Qi. > > I think this work should not take much time, so I can take care of it. It's > just the community is currently under feature freeze for release 1.9, so we > need to wait until the re

Re: YarnResourceManager unresponsive under heavy containers allocations

2019-07-09 Thread Yang Wang
It is a very useful optimization in large scale development. In blink we use a thread pool to launch container, and a flink cluster with more than 5000 Yarn containers could work well. Hope Xintong Song could contribute it to flink soon. Xintong Song 于2019年7月10日周三 下午2:20写道: > Thanks for the kind

Re: YarnResourceManager unresponsive under heavy containers allocations

2019-07-09 Thread Xintong Song
Thanks for the kindly offer, Qi. I think this work should not take much time, so I can take care of it. It's just the community is currently under feature freeze for release 1.9, so we need to wait until the release code branch being cut. Thank you~ Xintong Song On Wed, Jul 10, 2019 at 1:55

Re: YarnResourceManager unresponsive under heavy containers allocations

2019-07-09 Thread qi luo
Thanks Xintong and Haibo, I’ve found the fix in the blink branch. We’re also glad to help contribute this patch to community version, in case you don’t have time. Regards, Qi > On Jul 10, 2019, at 11:51 AM, Haibo Sun wrote: > > Hi, Qi > > Sorry, by talking to Xintong Song offline, I made su