Fabian Paul created FLINK-30238: ----------------------------------- Summary: Unified Sink committer does not clean up state on final savepoint Key: FLINK-30238 URL: https://issues.apache.org/jira/browse/FLINK-30238 Project: Flink Issue Type: Bug Components: Connectors / Common Affects Versions: 1.15.3, 1.17.0, 1.16.1 Reporter: Fabian Paul
During stop-with-savepoint the committer only commits the pending committables on notifyCheckpointComplete. This has several downsides. * Last committableSummary has checkpoint id LONG.MAX and is never cleared from the state leading to that stop-with-savepoint does not work when the pipeline recovers from a savepoint * While the committables are committed during stop-with-savepoint they are not forwarded to post-commit topology, potentially losing data and preventing to close open transactions. -- This message was sent by Atlassian Jira (v8.20.10#820010)