Re: How to use pipeline.jobvertex-parallelism-overrides property.

2023-08-25 Thread Krzysztof Chmielewski
Hi, thank you for replaying. Hang Ruan, regarding: " If they have different parallelisms, we cannot chain them together." <- that is clear for me. What I'm still not sure about is if " JobVertexId#toHexString" that should be used as key of pipeline.jobvertex-parallelism-overrides map is vertex o

Stoping a Job Without killing Task Manager

2023-08-25 Thread Kenan Kılıçtepe
Hi, When I try to stop a job, if the job can not be stopped after a while, task manager gets killed. This is a big problem for me as there may be other jobs running on the same task manager. Is there a way to stop jobs that get stuck for some reason without causing the task manager to terminate?

flink k8s operator - problem with patching seession cluster

2023-08-25 Thread Krzysztof Chmielewski
Hi community, I have a use case where I would like to add an extra TM) to a running Flink session cluster that has Flink jobs deployed. Session cluster creation, job submission and cluster patching is done using flink k8s operator Java API. The Details of this are presented here [1] I would like t