Hi all Thanks for the info, if you don’t mind, some more questions, thanks
When enable mirror maker from primary to secondary, it will mirror all data, say topic message along with offset, so when primary Kafka is down, user can switch to secondary Kafka to continue where left in primary Kafka? If primary is back, do we need to get user switch back to primary or let user stay at secondary? I’m afraid during primary downtime the topic offset in secondary is move on and primary Kafka recovered doesn’t have the latest offset info. Also, when primary is restored and user producer is switch to primary, will the topic offset stay at old value compare with secondary, if it is, when mirror maker copy message from new primary to running secondary, will it overwrite message in secondary as offset conflict? If we just want to have one way mirror, to have mirror config in one of the Kafka is good enough? Say to mirror from primary to secondary, config mirror in secondary and start Kafka connect service in both Kafka? Or should we always put mirror config in primary? Will mirror maker downgrade the performance if Kafka is busy? How mirror works, anytime new message comes in and mirror works in separate Kafka connect process? Thanks Calvin > 在 2021年3月5日，17:31，Ran Lupovich <ranlupov...@gmail.com> 写道： > > I guess that in case of avoiding data lose you would need to use 3 replica > in different rack/sites awareness to avoid data lose, Confluent's > Replicator or MirrorMaker are for copying data from one cluster to another > usually in different dc / regions, If I am not mistaken > > בתאריך יום ו׳, 5 במרץ 2021, 11:21, מאת Pushkar Deole <pdeole2...@gmail.com >> : > >> Thanks Luke... is the mirror maker asynchronous? What will be typical lag >> between the replicated cluster and running cluster and in case of disaster, >> what are the chances of data loss? >> >>> On Fri, Mar 5, 2021 at 11:37 AM Luke Chen <show...@gmail.com> wrote: >>> >>> Hi Pushkar, >>> MirrorMaker is what you're looking for. >>> ref: https://kafka.apache.org/documentation/#georeplication-mirrormaker >>> >>> Thanks. >>> Luke >>> >>> On Fri, Mar 5, 2021 at 1:50 PM Pushkar Deole <pdeole2...@gmail.com> >> wrote: >>> >>>> Hi All, >>>> >>>> I was looking for some options to backup a running kafka cluster, for >>>> disaster recovery requirements. Can someone provide what are the >>> available >>>> options to backup and restore a running cluster in case the entire >>> cluster >>>> goes down? >>>> >>>> Thanks.. >>>> >>> >>
