Re: Savepoint/checkpoint confusion

2021-05-22 Thread Robert Metzger
Hi Igor, In my understanding, checkpoints are managed by the system (Flink decides when to create and delete them), while savepoints are managed by the user (they decide when to create and delete them). Indeed, only checkpoints can be incremental (if that feature is enabled). > it's made on-dema

Re: Savepoint/checkpoint confusion

2021-05-20 Thread Igor Basov
Hey Robert, Thanks for the answer! But then I guess the only difference between savepoints and checkpoints is that checkpoints are structurally state dependent and can be incremental, but otherwise they are functionally equivalent. So functionally savepoint can be considered a full checkpoint which

Re: Savepoint/checkpoint confusion

2021-05-20 Thread Robert Metzger
Hey Igor, 1) yes, reactive mode indeed does the same. 2) No, HA mode is only storing some metadata in ZK about the leadership and latest checkpoints, but the checkpoints itself are the same. They should be usable for a changed job graph (if the state matches the operators by setting the UUIDs [1]

Savepoint/checkpoint confusion

2021-05-07 Thread Igor Basov
Hello, I got confused about usage of savepoints and checkpoints in different scenarios. I understand that checkpoints' main purpose is fault tolerance, they are more lightweight and don't support changing job graph, parallelism or state backend when restoring from them, as mentioned in the latest 1