[
https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17776196#comment-17776196
]
Dima Koroliyk commented on KAFKA-10339:
---------------------------------------
[~yangguo1220] Hello!
Can you please clarify whether EOS (Exactly Once Semantics) works for consuming
messages from replicated topics? For instance, if we have two clusters (A and
B) where topicA is replicated to cluster B (A.topicA), and we have two
consumers (A and B). If my producer publishes messages A, B, C, D to TopicA,
can MM2 be configured in a way that there will be no duplicates in the messages
read by Consumer A and Consumer B
!image-2023-10-17-15-33-57-983.png!
> MirrorMaker2 Exactly-once Semantics
> -----------------------------------
>
> Key: KAFKA-10339
> URL: https://issues.apache.org/jira/browse/KAFKA-10339
> Project: Kafka
> Issue Type: New Feature
> Components: KafkaConnect, mirrormaker
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Priority: Major
> Labels: needs-kip
> Fix For: 3.5.0
>
> Attachments: image-2023-10-17-15-14-53-533.png,
> image-2023-10-17-15-33-57-983.png
>
>
> MirrorMaker2 is currently implemented on Kafka Connect Framework, more
> specifically the Source Connector / Task, which do not provide exactly-once
> semantics (EOS) out-of-the-box, as discussed in
> https://github.com/confluentinc/kafka-connect-jdbc/issues/461,
> https://github.com/apache/kafka/pull/5553,
> https://issues.apache.org/jira/browse/KAFKA-6080 and
> https://issues.apache.org/jira/browse/KAFKA-3821. Therefore MirrorMaker2
> currently does not provide EOS.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)