Re: Mirror Maker 2 - offset sync from source to target

2023-10-23 Thread Alexander Shapiro (ashapiro)
Not a problem Greg. Is there some documentation explaining the same ? I tried to find a lot in the past From: Greg Harris Sent: Monday, October 23, 2023 11:23:26 PM To: users@kafka.apache.org Subject: Re: Mirror Maker 2 - offset sync from source to target [You

Re: Mirror Maker 2 - offset sync from source to target

2023-10-23 Thread sherry
Offset is an excellent artist On Mon, Oct 23, 2566 BE at 22:24 Greg Harris wrote: > Alexander, > > My apologies for calling you Andrew. > > Greg > > On Mon, Oct 23, 2023 at 1:22 PM Greg Harris wrote: > > > > Andrew, > > > > Yes, there isn't an explicit "create consumer group" operation, it > >

Re: Mirror Maker 2 - offset sync from source to target

2023-10-23 Thread Greg Harris
Alexander, My apologies for calling you Andrew. Greg On Mon, Oct 23, 2023 at 1:22 PM Greg Harris wrote: > > Andrew, > > Yes, there isn't an explicit "create consumer group" operation, it > should be created when MM2 emits a sync for it. > > Best, > Greg > > On Mon, Oct 23, 2023 at 1:15 PM Alexa

Re: Mirror Maker 2 - offset sync from source to target

2023-10-23 Thread Greg Harris
Andrew, Yes, there isn't an explicit "create consumer group" operation, it should be created when MM2 emits a sync for it. Best, Greg On Mon, Oct 23, 2023 at 1:15 PM Alexander Shapiro (ashapiro) wrote: > > Thanks, one clarification plz > > In bullet for You mention "4. The target group does not

RE: Mirror Maker 2 - offset sync from source to target

2023-10-23 Thread Alexander Shapiro (ashapiro)
Thanks, one clarification plz In bullet for You mention "4. The target group does not exist, or has no active consumers" If group on target does not exist, will it be created without active consumers ? -Original Message- From: Greg Harris Sent: Monday, October 23, 2023 8:56 PM To: user

Re: Mirror Maker 2 - offset sync from source to target

2023-10-23 Thread Greg Harris
Hi Alexander, Sorry I noticed an inconsistency in my last email. For point 6: If the MirrorCheckpointTask restarts after replication but before offset is translated, then it may not be able to perform a translation. If the MirrorCheckpointTask does not restart, it should be able to perform transla

RE: Mirror Maker 2 - offset sync from source to target

2023-10-23 Thread Alexander Shapiro (ashapiro)
Hi Greg, Thank you very much, it is the most detailed answer I would expect. -Original Message- From: Greg Harris Sent: Monday, October 23, 2023 8:42 PM To: users@kafka.apache.org Subject: Re: Mirror Maker 2 - offset sync from source to target CAUTION: This email is from an external so

Re: Mirror Maker 2 - offset sync from source to target

2023-10-23 Thread Greg Harris
Hi Alexander, Thanks for using MirrorMaker2! If you turn on `sync.group.offsets.enabled`, then the MirrorCheckpointTask will sync the offsets if all of the following is true: 1. The source group exists 2. The source group name matches the configured group filter (group.filter.class, groups, group