Fabian Paul created FLINK-26254:
-----------------------------------

             Summary: KafkaSink might violate order of sequence numbers and 
risk exactly-once processing
                 Key: FLINK-26254
                 URL: https://issues.apache.org/jira/browse/FLINK-26254
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Kafka
    Affects Versions: 1.14.3, 1.15.0
            Reporter: Fabian Paul


When running the KafkaSink in exactly-once mode with a very low checkpoint 
interval users are seeing `OutOfOrderSequenceException`.

It could be caused by the fact that the connector has a pool of KafkaProducers 
and the sequence numbers are not shared/reset if a new KafkaProducer tries to 
write to a partition while the previous KafkaProducer is still occupied for 
committing.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to