Re: Mirrormaker 2.0 - duplicates with idempotence enabled

2021-03-18 Thread Ning Zhang
gt; where is mentioned the “at-least” delivery guarantee? Just for the record. > > Kind Regards, > > Από: Ning Zhang > Αποστολή: Τετάρτη, 17 Μαρτίου 2021 22:39 > Προς: users@kafka.apache.org > Θέμα: Re: Mirrormaker 2.0 - duplicates with idempotence enabled > > Hello Vang

Re: Mirrormaker 2.0 - duplicates with idempotence enabled

2021-03-18 Thread Vangelis Typaldos
: Mirrormaker 2.0 - duplicates with idempotence enabled Hello Vangelis, By default, current MM 2.0 guarantees "at-least" once delivery guarantee, meaning there will be duplicate messages under some failure scenarios. If you prefer to no-message loss, there is a pending PR about MM

Re: Mirrormaker 2.0 - duplicates with idempotence enabled

2021-03-17 Thread Ning Zhang
Hello Vangelis, By default, current MM 2.0 guarantees "at-least" once delivery guarantee, meaning there will be duplicate messages under some failure scenarios. If you prefer to no-message loss, there is a pending PR about MM 2.0 https://issues.apache.org/jira/browse/KAFKA-10339 On 2021/03/10

Mirrormaker 2.0 - duplicates with idempotence enabled

2021-03-09 Thread Vangelis Typaldos
Hi, I have setup mirrormaker2 (Kafka v.2.6.0) on 2 clusters (CL1,CL2) and the mirroring seems to work properly except with an issue with duplicates in the following scenario: While both clusters are up and running i simulate an incident, stopping one by one the brokers of the CL2 cluster. Stopp