Hi, I’m reusing the same StreamTableEnvironment to submit multiple table/sql jobs to a session cluster, but I couldn’t find a proper way to specify job resources for each job (like parallelism and total process memory), and they all uses the cluster default.
I have considered overriding resources specs of all nodes in the StreamGraph, but it’s problematic because some nodes have a parallelism limit (e.g. can’t be greater than 1). I think I might be missing something and there should be a better way to do this. Please give me some pointers. Thanks a lot! Best, Paul Lam