Re: Flink KafkaProducer flushing on savepoints

2021-03-05 Thread Witzany, Tomas
Sent: 03 March 2021 21:10 To: Witzany, Tomas Cc: user@flink.apache.org Subject: Re: Flink KafkaProducer flushing on savepoints Hi, What Flink version and which FlinkKafkaProducer version are you using? `FlinkKafkaProducerBase` is no longer used in the latest version. I would guess some older

Flink KafkaProducer flushing on savepoints

2021-03-02 Thread Witzany, Tomas
Hi, I have a question about the at-least-once guarantees for Kafka producers when checkpointing is disabled. In our data pipeline we have a Flink job on an unlimited stream that originally, we had checkpoints turned on. Further this job is cancelled with a savepoint once a day to do some data pr