Danny Cranmer created FLINK-26417:
-------------------------------------
Summary: Async can Sink violate At Least Once during checkpointing
Key: FLINK-26417
URL: https://issues.apache.org/jira/browse/FLINK-26417
Project: Flink
Issue Type: Bug
Components: Connectors / Common
Reporter: Danny Cranmer
Fix For: 1.15.0
Async Sink holds data to send in 2 places:
- Buffered in queue
- "In-flight", being submitted by the async writer
When checkpointing we only capture the buffered requests. It seems like the
code to [wait for in-flight requests to
complete](https://github.com/apache/flink/blob/aab253a9141f1cdff81658eb47c7bb6ee9d2105c/flink-connectors/flink-connector-base/src/main/java/org/apache/flink/connector/base/sink/writer/AsyncSinkWriter.java#L402-L420)
has been removed/
Reinstate this mechanism to wait for in-flight requests to flush within
{{prepareCommit}}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
