Flink Action pipeline / Debezium-avro

Hi guys. Curious to understand. I'm busy trying to stitch together a Kafka -> Paimon pipeline using the action framework. I got this working using straight JSON. Currently modifying to be AVRO serialised onto the Kafka topic, this implies needing to use the debezium-avro CDC reader as there is n

Re: Clarification on checkpoint/savepoint usage with Kafka (and RabbitMQ)

I learned about this a couple of years ago when I was investigating the feasibility of a "Kafka stretch" cluster. From that email thread : > I got excited about this possibility, only to learn that Flink's KafkaSource does not use

Debezium extract from topic to be "inserted" into paimon

Think I'll eventually pass the library issues, actually remove some and the error stays the same so I'm going to assume those libraries were actually not required. So I'm consuming from a Confluent Kafka topic, which only gets records added to be inserted into paimon, no updates ever... My payloa

Synchronize the processElement and onTimer methods of a KeyedProcessFunction

Hi all, Not sure if it’s a typical use case but is it a good idea to synchronize the processElement and onTimer methods of a KeyedProcessFunction? In my case they both do changes in the function’s state (processElement initiates the state if not initialized and onTime clears the state) and I wo