[
https://issues.apache.org/jira/browse/FLINK-31305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17698798#comment-17698798
]
Martijn Visser commented on FLINK-31305:
----------------------------------------
[~mason6345] IIRC this would also affect Flink 1.17, right? If so, we should
open the PR in the Flink branch, so it can be fixed for Flink 1.17 (since the
connector is still bundled in 1.17) and then later cherry-picked to the
external connector repo, and potentially also Flink 1.16?
> KafkaWriter doesn't wait for errors for in-flight records before completing
> flush
> ---------------------------------------------------------------------------------
>
> Key: FLINK-31305
> URL: https://issues.apache.org/jira/browse/FLINK-31305
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
> Affects Versions: 1.17.0, 1.16.1
> Reporter: Mason Chen
> Assignee: Mason Chen
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.17.0
>
>
> The KafkaWriter flushing needs to wait for all in-flight records to send
> successfully. This can be achieved by tracking requests and returning a
> response from the registered callback from the producer#send() logic.
> There is potential for data loss since the checkpoint does not accurately
> reflect that all records have been sent successfully, to preserve at least
> once semantics.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
