Re: What does "Continuous incremental cleanup" mean in Flink 1.8 release notes

Hi Tony, yes, when taking a savepoint the same strategy as the during a non-incremental checkpoint is used. Best, Konstantin On Mon, Mar 11, 2019 at 2:29 AM Tony Wei wrote: > Hi Konstantin, > > That is really helpful. Thanks. > > Another follow-up question: The document said "Cleanup in full

Re: What does "Continuous incremental cleanup" mean in Flink 1.8 release notes

Hi Konstantin, That is really helpful. Thanks. Another follow-up question: The document said "Cleanup in full snapshot" is not applicable for the incremental checkpointing in the RocksDB state backend. However, when user manually trigger a savepoint and restart job from it, the expired states sho

Re: What does "Continuous incremental cleanup" mean in Flink 1.8 release notes

Hi Tony, before Flink 1.8 expired state is only cleaned up, when you try to access it after expiration, i.e. when user code tries to access the expired state, the state value is cleaned and "null" is returned. There was also already the option to clean up expired state during full snapshots ( http

What does "Continuous incremental cleanup" mean in Flink 1.8 release notes

Hi everyone, I read the Flink 1.8 release notes about state [1], and it said *Continuous incremental cleanup of old Keyed State with TTL* > We introduced TTL (time-to-live) for Keyed state in Flink 1.6 (FLINK-9510 > ). This feature allowed > to cl