Re: Best practice for creating/restoring savepoint in standalone k8 setup

2022-07-05 Thread Gyula Fóra
Hi Jonas! I think generally managed platforms used to provide the functionality that you are after. Otherwise it's mostly home grown CI/CD integrations :) The Kubernetes Operator is maybe the first initiative to bring proper application lifecycle management to the ecosystem directly. Cheers, Gyu

Re: Best practice for creating/restoring savepoint in standalone k8 setup

2022-07-05 Thread jonas eyob
Thanks Weihua and Gyula, @Weihia > If you restart flink cluster by delete/create deployment directly, it will be automatically restored from the latest checkpoint[1], so maybe just enabling the checkpoint is enough. Not sure I follow, we might have changes to the job that will require us to restor

Re: Best practice for creating/restoring savepoint in standalone k8 setup

2022-07-05 Thread Gyula Fóra
Hi! Did you check the https://github.com/apache/flink-kubernetes-operator by any chance? It provides many of the application lifecycle features that you are probably after straight out-of-the-box. It has both manual and periodic savepoint trig

Re: Best practice for creating/restoring savepoint in standalone k8 setup

2022-07-05 Thread Weihua Hu
Hi, jonas If you restart flink cluster by delete/create deployment directly, it will be automatically restored from the latest checkpoint[1], so maybe just enabling the checkpoint is enough. But if you want to use savepoint, you need to check whether the latest savepoint is successful (check wheth