Hi users, please help me here
---------- Forwarded message ---------
From: Taher Koitawala <taher...@gmail.com>
Date: Tue, 11 Feb 2025 at 11:59 AM
Subject: Flink CDC to Paimon
To: Selvam Ragav <selvam.ra...@gmail.com>, <d...@flink.apache.org>
Hi Devs,
As a POC we are trying to create a steaming pipeline from MSSQL cdc
to Paimon:
To do this we are doing
1. msSql server cdc operator
2. Transform operator
3. paimon sink
We have written the cdc connector with is a JsonDebeziumDeserialisedSchema
String
I wish to write this paimon in a table format with same columns as source.
As far as i know paimon automatically handles schema updates like new field
additions.
Please can someone point me on how to write this stream efficiently to
paimon table with schema updates?
For now i have SouceFunction<String>
Which is the record mentioned above!
Regards,
Taher Koitawala
