Nastaran Motavali
> Cc: user@flink.apache.org
> Subject: Re: Dulicated messages in kafka sink topic using flink
> cancel-with-savepoint operation
>
> Hi Nastaran,
>
> When you are checking for duplicated messages, are you reading from kafka
> using `read_commited
his sink, the
duplicated messages have not been read so everything is OK.
Kind regards,
Nastaran Motavalli
From: Piotr Nowojski
Sent: Thursday, November 29, 2018 3:38:38 PM
To: Nastaran Motavali
Cc: user@flink.apache.org
Subject: Re: Dulicated messages in kaf
Hi Nastaran,
When you are checking for duplicated messages, are you reading from kafka using
`read_commited` mode (this is not the default value)?
https://ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/kafka.html#kafka-producer-partitioning-scheme
> Semantic.EXACTLY_ONCE: uses Ka
