Re: Clarification on checkpoint/savepoint usage with Kafka (and RabbitMQ)

2025-03-18 Thread mejri houssem
Hello Ahmed, Thanks for the response. Does that mean checkpoints and savepoints have nothing to do with the at-least-once guarantee, since it depends solely on the starting offset configuration? Best Regards Le mar. 18 mars 2025 à 23:59, Ahmed Hamdy a écrit : > Hi Mejri > > > I’m wondering if

Re: Clarification on checkpoint/savepoint usage with Kafka (and RabbitMQ)

2025-03-18 Thread Ahmed Hamdy
Hi Mejri > I’m wondering if this is strictly necessary, since the Kafka broker itself keeps track of offsets (i am not mistaken). In other words, if we redeploy the job, will it automatically resume from the last Kafka offset, or should we still rely on Flink’s checkpoint/savepoint mechanism to en

Clarification on checkpoint/savepoint usage with Kafka (and RabbitMQ)

2025-03-18 Thread mejri houssem
Hello everyone, We have a stateless Flink job that uses a Kafka source with at-least-once guarantees. We’ve enabled checkpoints so that, in the event of a restart, Flink can restore from the last committed offset stored in a successful checkpoint. Now we’re considering enabling savepoints for our