Re: MirrorMaker 2.0 - Translating offsets for remote topics and consumer groups

2020-08-20 Thread Josh C
low a remote topic to be checkpointed. I'd support > changing this, fwiw. > > Ryanne > > On Wed, Aug 19, 2020 at 2:30 PM Josh C wrote: > > > Sorry, correction -- I am realizing now it would be 3 copies of the same > > topic data as A.topic1 has different da

Re: MirrorMaker 2.0 - Translating offsets for remote topics and consumer groups

2020-08-19 Thread Josh C
the source cluster by adding it to the topic whitelist, would I also need to update the topic blacklist and remove ".*\.replica" (since the blacklists take precedence over the whitelists)? Josh On Wed, Aug 19, 2020 at 11:46 AM Josh C wrote: > Thanks for the clarification Ryanne. I

Re: MirrorMaker 2.0 - Translating offsets for remote topics and consumer groups

2020-08-19 Thread Josh C
fter the first checkpoint is emitted upstream, > RemoteClusterUtils.translateOffsets() will translate B's A.test1 offsets > into A's test1 offsets for you. > > Ryanne > > On Tue, Aug 18, 2020 at 5:56 PM Josh C wrote: > > > Hi there, > > > > I'm currently exploring MM2 and havin

MirrorMaker 2.0 - Translating offsets for remote topics and consumer groups

2020-08-18 Thread Josh C
Hi there, I'm currently exploring MM2 and having some trouble with the RemoteClusterUtils.translateOffsets() method. I have been successful in migrating a consumer group from the source cluster to the target cluster, but was wondering how I could migrate this consumer group back to the original so