Yes, I meant true general purpose exactly-once :)
> There are some ideas about using a WAL (write ahead log) and then
periodically "shipping" that to Kafka but nothing concrete.
But that would still need to be using Kafka transactions for "shipping"
records. That's what I meant that one way or an
On 2021/01/08 10:00, Piotr Nowojski wrote:
Moreover I don't think there is a way to implement exactly once producer
without some use of transactions one way or another.
There are some ways I can think of. If messages have consistent IDs, we
could check whether a message is already in Kafka bef
On 2021/01/07 14:17, Pramod Immaneni wrote:
Is there a Kafka producer that can do exactly once semantic without the use
of transactions?
I'm afraid not right now. There are some ideas about using a WAL (write
ahead log) and then periodically "shipping" that to Kafka but nothing
concrete.
Be
Hi Pramod,
Moreover I don't think there is a way to implement exactly once producer
without some use of transactions one way or another.
Best,
Piotrek
pt., 8 sty 2021 o 09:34 Till Rohrmann napisał(a):
> Hi Pramod,
>
> Flink's Kafka connector uses transactions in order to support exactly once
>
Hi Pramod,
Flink's Kafka connector uses transactions in order to support exactly once
semantic.
Cheers,
Till
On Thu, Jan 7, 2021 at 11:17 PM Pramod Immaneni wrote:
> Is there a Kafka producer that can do exactly once semantic without the use
> of transactions?
>
> Thanks
>
Is there a Kafka producer that can do exactly once semantic without the use
of transactions?
Thanks
