Sorry, it seems related our own bug, after fixed the defect it can scale automatically.
Thanks for your reply. Weihua Hu <huweihua....@gmail.com> 于2023年3月21日周二 12:02写道： > Hi, > > Yarn session clusters should auto allocate new task managers if slots are > not enough. > And the new submitting should not affect running jobs. > > Could you provide the failure log? > > Best, > Weihua > > > On Tue, Mar 21, 2023 at 11:57 AM Si-li Liu <unix...@gmail.com> wrote: > >> I use this command to launch a flink yarn session. >> >> yarn-session.sh -s 6 -jm 2048 -tm 4096 -nm sql-client-session -m >> yarn-cluster -d >> >> And all my flink sql job has 2 parallelism, and I found that my yarn >> session can only have 3 pipelines. If my session doesn't have free slot, >> submit to this session will cause exists pipeline failed. Can the yarn >> session auto allocate new TM when it runs out its free slots? >> -- >> Best regards >> >> Sili Liu >> > -- Best regards Sili Liu
