Hi Morgan, Jobs running in a session cluster share the taskmanagers, so you are not able to configure them on a per job basis. I welcome you to check out the Flink Kubernetes Operator's session job example [1] that highlights this behavior: You specify container resources when you submit the session initially.
Why are you using the session cluster in this case, seems you would be better served by application mode if you need to configure resources individually. [1] https://github.com/apache/flink-kubernetes-operator/blob/main/examples/basic-session-job.yaml Best, Marton On Wed, May 11, 2022 at 3:43 PM Geldenhuys, Morgan Karl < morgan.geldenh...@tu-berlin.de> wrote: > Greetings all, > > > I have a question concerning resource allocation for Apache flink. I have > a flink native session cluster running and im interested in rolling out > multiple jobs. However, I would like to size the container resources (CPU > and Memory) differently for each job, is this possible? i.e. send the > container size as part of the REST API request. Are is this something which > can only be done through Kubernetes? i.e. before each job is deployed, > communicate with the kube master and update the spec. > > > Thank you very much in advance. > > > Regards, > > M. >
