[ https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17895988#comment-17895988 ]
Galen Warren commented on FLINK-36455: -------------------------------------- [~arvid] Thanks for this! Do you think this will be backported into any 1.x releases or is this just for 2.0? > Sink should commit everything on notifyCheckpointCompleted > ---------------------------------------------------------- > > Key: FLINK-36455 > URL: https://issues.apache.org/jira/browse/FLINK-36455 > Project: Flink > Issue Type: Bug > Components: API / Core > Reporter: Arvid Heise > Assignee: Arvid Heise > Priority: Major > Labels: pull-request-available > Fix For: 2.0.0 > > > Currently, we retry committables at some time later until they eventually > succeed. > However, that violates the contract of notifyCheckpointCompleted which states > that all side effect must be committed before returning the method. In > particular, notifyCheckpointCompleted must fail if we cannot guarantee that > all side effects are committed for final checkpoints. As soon as > notifyCheckpointCompleted returns, the final checkpoint is deemed completed, > which currently may mean that some transactions are still open. > The solution is that all retries must happen in a close loop in > notifyCheckpointCompleted. -- This message was sent by Atlassian Jira (v8.20.10#820010)