Re: At-least once sinks and their behaviour in a non-failure scenario

2022-05-12 Thread Alexander Preuß
Hi Piotr, You are correct regarding the Savepoint, there should be no duplicates sent to RabbitMQ. Best regards, Alexander On Thu, May 12, 2022 at 11:28 AM Piotr Domagalski wrote: > Hi, > > I'm planning to build a pipeline that is using Kafka source, some stateful > transformation and a Rabbit

At-least once sinks and their behaviour in a non-failure scenario

2022-05-12 Thread Piotr Domagalski
Hi, I'm planning to build a pipeline that is using Kafka source, some stateful transformation and a RabbitMQ sink. What I don't yet fully understand is how common should I expect the "at-least once" scenario (ie. seeing duplicates) on the sink side. The case when things start failing is clear to m