Arvid Heise created FLINK-18404: ----------------------------------- Summary: Make unaligned checkpoints rescalable Key: FLINK-18404 URL: https://issues.apache.org/jira/browse/FLINK-18404 Project: Flink Issue Type: Improvement Components: Runtime / Checkpointing Affects Versions: 1.12.0 Reporter: Arvid Heise
Currently, the in-flight data of unaligned checkpoints is not handled properly in rescaling scenarios. We guarded with a fail-safe exception against it. A proper rescaling support would increase the benefits of unaligned checkpoints. To rescale in-flight data, the state shard needs to be redistributed across all new assigned tasks and some additional filter needs to ensure that only the relevant key-groups are actually recovered (or processed). -- This message was sent by Atlassian Jira (v8.3.4#803005)