Re: Help on MM2 -- only copy new data

2022-06-13 Thread An, Hongguo (CORP)
Thanks, Jamie: I tried, but still not working☹, here is the updated properties file: clusters=CDL,PC CDL.bootstrap.servers=xxx PC.bootstrap.servers=xx PC.security.protocol=SSL consumer.auto.offset.reset=earliest group.id=test-mm2-2 CDL->PC.enabled=true topics= .* groups= .* topic.blacklist= .*[

Re: Help on MM2 -- only copy new data

2022-06-13 Thread Jamie
Hi An, Try setting consumer.auto.offset.reset=earliest  This will mean if the consumers in the MM2 tasks don’t have an offset for a topic partition they will start at the beginning. If you’ve already enabled the below you might have to use a new group.id so that the consumers no longer have an of

Re: Help on MM2 -- only copy new data

2022-06-13 Thread An, Hongguo (CORP)
Correction, its 3.2.0 From: "An, Hongguo (CORP)" Date: Monday, June 13, 2022 at 4:12 PM To: "users@kafka.apache.org" Subject: Help on MM2 -- only copy new data Hi: I am trying to use MM2 ( 3.2.0) to migration Kafka to a new server, but looks like it only copys new data,

Help on MM2 -- only copy new data

2022-06-13 Thread An, Hongguo (CORP)
Hi: I am trying to use MM2 ( 3.3.0) to migration Kafka to a new server, but looks like it only copys new data, any existing data is not copied. Here is the connection properties: clusters=CDL,PC CDL.bootstrap.servers=xxx PC.bootstrap.servers=xxx PC.security.protocol=SSL CDL->PC.enabled