Re: MirrorMaker 2 and Negative Lag

2021-03-25 Thread Alan Ning
Another update on this. I am pretty sure I have found a bug in MirrorSourceTask. The details are written in https://issues.apache.org/jira/browse/KAFKA-12558. I hope this helps others who have encountered this issue. ... Alan On Thu, Mar 25, 2021 at 9:40 AM Alan Ning wrote: > Just an upd

Re: MirrorMaker 2 and Negative Lag

2021-03-25 Thread Alan Ning
task, but I have yet to find any documentation for it. ... Alan On Wed, Mar 17, 2021 at 5:49 PM Alan Ning wrote: > OK. I follow now. Let me try to re-test to see if it makes a difference. > > Thanks. > > ... Alan > > On Wed, Mar 17, 2021 at 5:46 PM Samuel Cantero > wr

Re: MirrorMaker 2 and Negative Lag

2021-03-17 Thread Alan Ning
g `consumer.auto.offset.reset:earliest` and do > > verify if offsets are sync'd correctly. > > > > Best, > > > > On Wed, Mar 17, 2021 at 6:42 PM Alan Ning wrote: > > > >> Hey Samuel, > >> > >> I am aware of that `consumer.auto.

Re: MirrorMaker 2 and Negative Lag

2021-03-17 Thread Alan Ning
wrote: > Hello Alan, > > I may probably see the similar case. One quick validation that could be > run is to test on the source cluster with higher Kafka version. If still > not working, please email me and I could introduce you to person who may > have similar case before. > >

Re: MirrorMaker 2 and Negative Lag

2021-03-17 Thread Alan Ning
ably see the similar case. One quick validation that could be > > run is to test on the source cluster with higher Kafka version. If still > > not working, please email me and I could introduce you to person who may > > have similar case before. > > > > On 2021/03/15

MirrorMaker 2 and Negative Lag

2021-03-15 Thread Alan Ning
I am running MirrorMaker 2 (Kafka 2.7), trying to migrate all topics from one cluster to another while preserving through `sync.group.offsets.enabled=true`. My source cluster is running Kafka 0.10, while the target cluster is running 2.6.1. While I can see data being replicated, the data on the re