I should note - this job is being run in batch mode. Could there be a deadlock related to FLINK-16430?
On Mon, 20 Sept 2021 at 11:26, Dave Maughan <davidamaug...@gmail.com> wrote: > Hi, > > I have a Flink job on EMR with an operator stuck on CREATED. The subtasks > are not being assigned to task manager slots. The previous operator is > running and has non-zero Bytes Sent and Records Sent. When the job started > the Job manager requested new workers to start a bunch of the operators but > it's not requesting any more so the available slots is 0 and the job just > seems to have stalled. Any pointers on what I might be doing wrong? > > I'm specifying parallelism 24 and that's how many task slots are being > requested by the job manager but also how many subtasks are being created > each operator. Should I (if so how) specify these two numbers separately? > > Thanks, > Dave >
