Re: mirrormaker 2.0

2021-04-26 Thread Frank Yi
Hey Madhan, The easiest way to get rid of aliases in the topic names is to add the following to your config: replication.policy.separator= source.cluster.alias= target.cluster.alias= On Thu, Apr 22, 2021 at 11:40 PM Dhanikachalam, Madhan (CORP) wrote: > I am testing MM2. I got the connector

Re: MirrorMaker 2 and Negative Lag

2021-04-08 Thread Frank Yi
r and > Alan's observations into it, then assign it to me (also would be great to > refer this link)? > > I will take some time to reproduce it when available. > > Thanks > > On 2021/03/30 19:08:56, Frank Yi wrote: > > Hey Ning, > > > > I believe &quo

Re: MirrorMaker 2 and Negative Lag

2021-03-30 Thread Frank Yi
at destination, sync the offset from source > > > https://github.com/apache/kafka/blob/c19a35d1b740c85559a7ff4e882fc95b4737808d/connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorCheckpointTask.java#L270-L279 > > If you have any suggested change, please share with me. Tha

Re: MirrorMaker 2 and Negative Lag

2021-03-23 Thread Frank Yi
Hey Alan, I'm running into the same issue as you and I believe I've figured it out. I noticed that consumer partitions on the destination cluster that have a LOG-END-OFFSET=0 all exhibit this issue. It looks like Mirrormaker's offset sync does not work correctly if the partition is empty. Instead

Re: MirrorMaker 2 and Negative Lag

2021-03-23 Thread Frank Yi
Hey Alan, I'm running into the same issue as you and I believe I've figured it out. I noticed that consumer partitions on the destination cluster that have a LOG-END-OFFSET=0 all exhibit this issue. It looks like Mirrormaker's offset sync does not work correctly if the partition is empty. Instead