Flink CDC -> Kafka -> Paimon?

Hi! I really like Flink CDC's pipeline connectors ! So simple! I also like Paimon's CDC ingestion action CLI . I like t

Task manager has no more allocated slots for job

Hi getting the following exception. I have 3 task managers running and they all have enough slots available. See screenshot. 2024-10-25 10:00:31 org.apache.flink.util.FlinkException: TaskExecutor akka.tcp://fl...@xxx.xxx.xxx:42441/user/rpc/taskmanager_0 has no more allocated slots for job 925415d3

Re: Kafka sink producing record at event timestamp

there is one option of configuring this in kafka at the topic level """ By default Kafka will use the timestamp provided by the producer. However, you can also make Kafka update the timestamp when it writes the record to the log by setting messa

Kafka sink producing record at event timestamp

Hi, I am having a pipeline where source and sink are two Kafka topics. The pipeline uses event time semantics, where event time is extracted from the record. What I notice is that when producing records at the sink side, it produces them such that the record's time in the kafka topic is the same a

Re: Flink custom sink

Hello all, Are there Flink patterns that support microbatching and ensure all data for a microbatch is written to a specific prefix in the destination with exactly-once delivery? I’ve explored both window and processing time (implemented in FileSink) options to set the boundaries for microbatches.

Re: [ANNOUNCE] Apache Flink 2.0 Preview released

Hi Enric I clone the code from apache/flink repo and import it to Idea, But there was nothing unexpected. 在 2024年10月23日星期三，Enric Ott <243816...@qq.com> 写道： > How to import the source code(from github) to Intelligent Idea,seems that > a project descriptor is missing. > > > -- 原始邮件