Hi, I have a Flink job on EMR with an operator stuck on CREATED. The subtasks are not being assigned to task manager slots. The previous operator is running and has non-zero Bytes Sent and Records Sent. When the job started the Job manager requested new workers to start a bunch of the operators but it's not requesting any more so the available slots is 0 and the job just seems to have stalled. Any pointers on what I might be doing wrong?
I'm specifying parallelism 24 and that's how many task slots are being requested by the job manager but also how many subtasks are being created each operator. Should I (if so how) specify these two numbers separately? Thanks, Dave