[
https://issues.apache.org/jira/browse/KAFKA-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16957289#comment-16957289
]
ASF GitHub Bot commented on KAFKA-9076:
---------------------------------------
ning2008wisc commented on pull request #7577: KAFKA-9076: support consumer sync
across clusters in MM 2.0
URL: https://github.com/apache/kafka/pull/7577
In order to make the Kafka consumer and stream application migrate from
source to target cluster
transparently and conveniently, e.g. in event of source cluster failure, a
background job is proposed
to periodically sync the consumer offsets from the source to target cluster,
so that when the
consumer and stream applications switch to the target cluster, they will
resume to consume from
where they left off at source cluster.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> MirrorMaker 2.0 automated consumer offset sync
> ----------------------------------------------
>
> Key: KAFKA-9076
> URL: https://issues.apache.org/jira/browse/KAFKA-9076
> Project: Kafka
> Issue Type: Improvement
> Components: mirrormaker
> Affects Versions: 2.4.0
> Reporter: Ning Zhang
> Priority: Major
> Labels: mirrormaker, pull-request-available
> Fix For: 2.5.0
>
>
> To calculate the translated consumer offset in the target cluster, currently
> `Mirror-client` provides a function called "remoteConsumerOffsets()" that is
> used by "RemoteClusterUtils" for one-time purpose.
> In order to make the consumer migration from source to target cluster
> transparent and convenient, e.g. in event of source cluster failure, it is
> better to have a background job to continuously and periodically sync the
> consumer offsets from the source to target cluster, so that when the consumer
> switches to the target cluster, it will resume to consume from where it left
> off at source cluster.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
