Checkout new task manager instances connection status, if connect to job manager is normal, check available slot, check create connection at function initializes.
> On Nov 11, 2021, at 18:01, Xiangyu Su <xian...@smaato.com> wrote: > > Thank you Jake! > Enable debug level logging,,,, have to ask system engineer first ;) > do you know how to resolve this issue? > > Best > > On Thu, 11 Nov 2021 at 10:57, Jake <ft20...@qq.com <mailto:ft20...@qq.com>> > wrote: > > Set log root level is DEBUG and check Job manager logs, you will get it. > > > >> On Nov 11, 2021, at 17:02, Xiangyu Su <xian...@smaato.com >> <mailto:xian...@smaato.com>> wrote: >> >> Hello Everyone, >> >> We are facing an issue on Flink 1.14.0. >> Every time if the job gets restarted, some tasks/slots get stuck in >> INITIALIZING state, and will never switch to RUNNING. >> >> Any idea/suggestion about a solution to this issue? >> >> btw, our flink cluster runs on EKS, and using AWS spot instance for Task >> manager, once spot instances get lost and then get new instances this issue >> will always happen. >> >> Best, >> -- >> Xiangyu Su >> Senior Data Engineer >> xian...@smaato.com <mailto:xian...@smaato.com> >> >> Smaato Inc. >> San Francisco - New York - Hamburg - Singapore >> www.smaato.com <http://www.smaato.com/> >> >> Germany: >> Barcastraße 5 >> 22087 Hamburg >> Germany >> M 0049(176)43330282 >> >> The information contained in this communication may be CONFIDENTIAL and is >> intended only for the use of the recipient(s) named above. If you are not >> the intended recipient, you are hereby notified that any dissemination, >> distribution, or copying of this communication, or any of its contents, is >> strictly prohibited. If you have received this communication in error, >> please notify the sender and delete/destroy the original message and any >> copy of it from your computer or paper files. > > > > -- > Xiangyu Su > Senior Data Engineer > xian...@smaato.com <mailto:xian...@smaato.com> > > Smaato Inc. > San Francisco - New York - Hamburg - Singapore > www.smaato.com <http://www.smaato.com/> > > Germany: > Barcastraße 5 > 22087 Hamburg > Germany > M 0049(176)43330282 > > The information contained in this communication may be CONFIDENTIAL and is > intended only for the use of the recipient(s) named above. If you are not the > intended recipient, you are hereby notified that any dissemination, > distribution, or copying of this communication, or any of its contents, is > strictly prohibited. If you have received this communication in error, please > notify the sender and delete/destroy the original message and any copy of it > from your computer or paper files.