Re: Savepoints not considered during failover

2024-06-07 Thread Mate Czagany
Hi, I think this was last discussed in FLIP-193 [1] where the reasoning is mostly the same as Matthias said, savepoints are owned by the user and Flink cannot depend on them. In older versions Flink also took savepoints into account when restoring a job, with the possibility to skip savepoints by

Re: Savepoints not considered during failover

2024-06-06 Thread Matthias Pohl
One reason could be that the savepoints are self-contained, owned by the user rather than Flink and, therefore, could be moved. Flink wouldn't have a proper reference in that case anymore. I don't have a link to a discussion, though. Best, Matthias On Fri, Jun 7, 2024 at 8:47 AM Gyula Fóra wrot

Savepoints not considered during failover

2024-06-06 Thread Gyula Fóra
Hey Devs! What is the reason / rationale for savepoints being ignored during failover scenarios? I see they are not even recorded as the last valid checkpoint in the HA metadata (only the checkpoint id counter is bumped) so if the JM fails after a manually triggered savepoint the job will still f