Re: Ambiguous behavior of Flink on Job cancellation with checkpoint configured

2019-03-22 Thread Parth Sarathy
That makes sense. Thanks for the clarification. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Ambiguous behavior of Flink on Job cancellation with checkpoint configured

2019-03-21 Thread Aljoscha Krettek
Hi, That’s a good observation! And it is indeed the expected behaviour. There are two parts to understanding this: * "retain checkpoints” tells Flink to retain any checkpoints that it stores when a job is shut down * for recovery purposes (all checkpointing purposes, really) a savepoint count

Ambiguous behavior of Flink on Job cancellation with checkpoint configured

2019-03-21 Thread Parth Sarathy
Hi All, We are using flink 1.7.2 and have enabled checkpoint with RocksDB configured as state backend with retain checkpoints on job cancel. In our scenario we are cancelling the job and while resubmitting the job, we try to restore the job with latest checkpoint / savepoint availabl