Re: Idempotent producer and handling OutOfOrderSequenceException

2025-04-20 Thread Matthias J. Sax
Thanks for providing more details. It makes sense that you need to ensure that an "insert" comes before an "update". If I understand you correctly, that's what idempotence guarantees. If the PUT is not appended to the log, it will be retried, but then thread 2 can't have observed it. Yes.

Re: External State Store and EOS still "broken"?

2025-04-20 Thread Matthias J. Sax
Yes, that is still the case. I believe, KIP-892 should fix this. https://cwiki.apache.org/confluence/display/KAFKA/KIP-892%3A+Transactional+Semantics+for+StateStores -Matthias On 4/17/25 7:00 AM, Chad Preisler wrote: Hello, Way back in 2021 there was a thread on here about using Redis as a

Re: KTable restoration

2025-04-20 Thread Matthias J. Sax
Yes, since Kafka 3.8, there is a so called "state updated thread". https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/processor/internals/DefaultStateUpdater.java#L183 -Matthias On 4/17/25 6:58 AM, Chad Preisler wrote: In the latest version of Kafka Str