Re: Recover watermark from savepoint

2022-07-05 Thread Sweta Kalakuntla
. > > > > What do you think? > > > > Thias > > > > > > *From:* David Anderson > *Sent:* Thursday, June 9, 2022 11:35 AM > *To:* User-Flink > *Subject:* Re: Recover watermark from savepoint > > > > Sweta, > > > > Flink doe

RE: Recover watermark from savepoint

2022-06-09 Thread Schwalbe Matthias
above timer (once) Feel free to ask details, I hope this helps … I need to ask my folks whether I can share our implementation (20 lines of code, odd). What do you think? Thias From: David Anderson Sent: Thursday, June 9, 2022 11:35 AM To: User-Flink Subject: Re: Recover watermark from

Re: Recover watermark from savepoint

2022-06-09 Thread David Anderson
Sweta, Flink does not include watermarks in savepoints, nor are they included in aligned checkpoints. For what it's worth, I believe that with unaligned checkpoints in-flight watermarks are included in checkpoints, but I don't believe that would solve the problem, since the watermark strategy's st

Recover watermark from savepoint

2022-06-08 Thread Sweta Kalakuntla
Hi, I want to understand if flink saves a watermark during savepoint and if not, how do we achieve this? We are seeing an issue where on recovery, the job processes some late events which should have been discarded if the job were to be running without any downtime. Thank you, Sweta