Re: flink kafka sink batch mode delivery guaranties limitations

2024-08-23 Thread Nicolas Paris
Thanks, missed that warning ! All right

Re: flink kafka sink batch mode delivery guaranties limitations

2024-08-23 Thread Ahmed Hamdy
Hi Nicholas, Could you elaborate what you think is missing? I can see there is a warning that EXACTLY_ONCE sink wouldn't operate. > It is important to remember that because there are no checkpoints, certain features such as CheckpointListener

flink kafka sink batch mode delivery guaranties limitations

2024-08-23 Thread Nicolas Paris
hi >From my tests kafka sink in exactly-once and batch runtime will never commit the transaction, leading to not honour the semantic. This is likely by design since records are ack/commited during a checkpoint, which never happens in batch mode. I am missing something or the documentation should w