Re: Flink CDC to Paimon

2025-02-11 Thread Xiqian YU
Hi Taher, Since we’re creating a DataStream-based pipeline job with SQL Server CDC, schema change events must be handled manually. A possible approach would be: 1) Enable schema change events with `.includeSchemaChanges(true)` option, so DDL events will be parsed and encoded in `SourceRecord`s.

Flink CDC to Paimon

2025-02-11 Thread Taher Koitawala
Hi Devs, As a POC we are trying to create a steaming pipeline from MSSQL cdc to Paimon: To do this we are doing 1. msSql server cdc operator 2. Transform operator 3. paimon sink We have written the cdc connector with is a JsonDebeziumDeserialisedSchema String I wish to write this paimon i

[jira] [Created] (FLINK-36790) Flink CDC to Paimon: DeletionVectorsMaintainer CME problem

2024-11-25 Thread Rascal Wu (Jira)
Rascal Wu created FLINK-36790: - Summary: Flink CDC to Paimon: DeletionVectorsMaintainer CME problem Key: FLINK-36790 URL: https://issues.apache.org/jira/browse/FLINK-36790 Project: Flink Issue