Hi everyone, I'd like to discuss FLIP-461 [1]. The FLIP proposes the synchronization of rescaling and the completion of checkpoints. The idea is to reduce the amount of data that needs to be processed after rescaling happened. A more detailed motivation can be found in FLIP-461.
I'm looking forward to feedback and suggestions. Best, Matthias [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-461%3A+Synchronize+rescaling+with+checkpoint+creation+to+minimize+reprocessing