Re: Questions on Restarting a Flink Application from a savepoint or checkpoint

2023-07-21 Thread Gyula Fóra
ttps://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/job-management/#stateful-and-stateless-application-upgrades >>>>>> >>>>>> The operator is made especially to handle stateful application >>>>>> upgra

Re: Questions on Restarting a Flink Application from a savepoint or checkpoint

2023-07-21 Thread Tony Chen
de` setting for jobs, as >>>>> long as you have last-state or savepoint you will always get the latest >>>>> state. >>>>> >>>>> This is somewhat orthogonal to the savepoint trigger / >>>>> initialSavepointPath mechanisms. The i

Re: Questions on Restarting a Flink Application from a savepoint or checkpoint

2023-07-19 Thread Gyula Fóra
>>> operator is not aware of the latest state. After that all upgrades always >>>> use the latest state unless the upgradeMode is stateless in which case no >>>> state is used. Savepoint triggering can help you keep backups for failure >>>> recovery but t

Re: Questions on Restarting a Flink Application from a savepoint or checkpoint

2023-07-19 Thread Tony Chen
> operator is not aware of the latest state. After that all upgrades always >>> use the latest state unless the upgradeMode is stateless in which case no >>> state is used. Savepoint triggering can help you keep backups for failure >>> recovery but they should

Re: Questions on Restarting a Flink Application from a savepoint or checkpoint

2023-07-19 Thread Gyula Fóra
ing can help you keep backups for failure >> recovery but they should not be executed as part of your upgrade flow >> because the operator already does this for you. >> >> Cheers, >> Gyula >> >> On Wed, Jul 19, 2023 at 8:20 PM Tony Chen >> wrote: >&g

Re: Questions on Restarting a Flink Application from a savepoint or checkpoint

2023-07-19 Thread Tony Chen
link Community, >> >> My name is Tony Chen, and I am a software engineer at Robinhood. I have >> some questions on restarting a Flink Application from a savepoint or >> checkpoint. >> >> We currently store our checkpoints and savepoints in S3, and we would >>

Re: Questions on Restarting a Flink Application from a savepoint or checkpoint

2023-07-19 Thread Gyula Fóra
Chen, and I am a software engineer at Robinhood. I have > some questions on restarting a Flink Application from a savepoint or > checkpoint. > > We currently store our checkpoints and savepoints in S3, and we would like > to use the Apache Flink Kubernetes Operator to manage our Flin

Questions on Restarting a Flink Application from a savepoint or checkpoint

2023-07-19 Thread Tony Chen
Hi Flink Community, My name is Tony Chen, and I am a software engineer at Robinhood. I have some questions on restarting a Flink Application from a savepoint or checkpoint. We currently store our checkpoints and savepoints in S3, and we would like to use the Apache Flink Kubernetes Operator to