Re: Job uptime metric in Flink Operator managed cluster

2022-10-13 Thread Mason Chen
Hi all, I think what Meghajit is trying to understand is how to measure the uptime of a submitted Flink job. Prior to the K8s operator, perhaps the job manager was torn down with the job shutdown so the uptime value would stop; therefore, the uptime value also measures how long the job was running

Re: Job uptime metric in Flink Operator managed cluster

2022-10-12 Thread Gyula Fóra
Sorry, what I said applies to Flink 1.15+ and the savepoint upgrade mode (not stateless). In any case if there is no job manager there are no metrics... So not sure how to answer your question. Gyula On Thu, Oct 13, 2022 at 8:24 AM Meghajit Mazumdar < meghajit.mazum...@gojek.com> wrote: > Hi Gy

Re: Job uptime metric in Flink Operator managed cluster

2022-10-12 Thread Meghajit Mazumdar
Hi Gyula, Thanks for the prompt response. > The Flink operator currently does not delete the jobmanager pod when a deployment is suspended. Are you sure this is true ? I have re-tried this many times, but each time the pods get deleted, along with the deployment resources. Additionally, the flin

Re: Job uptime metric in Flink Operator managed cluster

2022-10-12 Thread Gyula Fóra
Hello! The Flink operator currently does not delete the jobmanager pod when a deployment is suspended. This way the rest api stay available but no other resources are consumed (taskmanagers are deleted) When you delete the FlinkDeployment resource completely, then the jobmanager deployment is also

Job uptime metric in Flink Operator managed cluster

2022-10-12 Thread Meghajit Mazumdar
Hello, I recently deployed a Flink Operator in Kubernetes and wrote a simple FlinkDeployment CRD to run it in application mode following this . I noticed that, even after I edited the CRD and marked the sp