Hi, We have Flink 1.8.0 cluster deployed in Hadoop distributed mode, I often see even though Hadoop has enough resources Flink sits in Created state. We have 4 operators using 15 parallelism, 1 operator using 40 & 2 operators using 10. At time of submission I'm passing taskmanager memory as 4Gb and job manager memory as 2gb. and 2 slots This request should only take 20 containers and 40 Vcores. But I see Flink is overallocating resource of 65 containers and 129 Cores . I've attached snapshots for references.
Right now I'm passing: -yD yarn.heartbeat.container-request-interval=1000 -yD taskmanager.network.memory.fraction=0.045 -yD taskmanager.memory.preallote=true. How do I control resource allocation?.
