Re: [DISCUSS] Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-06-14 Thread Jerry
The content has been edited in FLIP format, but I don't have wiki permissions and can't create a wiki document. https://docs.google.com/document/d/1bgKV9Teq8ktHZOAJ7EKzgSqP11Q4ZT2EM8BndOtDgy0/edit Leonard Xu 于2024年5月21日周二 22:50写道: > Thanks Jerry for kicking off this thread, the idea makes sense

Re: [DISCUSS] Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-06-02 Thread Jerry
As far as I know, after the Flink-CDC table structure is changed, a broadcast will be sent, causing other operators to suspend data synchronization tasks and wait for the structure change to succeed before continuing. This will cause data synchronization to terminate during the structure change and

Re: [DISCUSS] Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-05-22 Thread Yanquan Lv
Thanks jerry for driving this, JDBC sink for CDC pipeline is indeed a high demand in the community. I have one concern: Some databases that use jdbc, such as mysql, may be time-consuming to perform table structure changes, but FlinkCDC will not send DataChangeEvent during this period, which can ca

Re: [DISCUSS] Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-05-21 Thread Leonard Xu
Thanks Jerry for kicking off this thread, the idea makes sense to me, JDBC Sink is users’ need and Flink CDC project should support it soon. Could you share your design docs(FLIP) firstly[1]? And then we can continue the design discussion. Please feel free to ping me if you have any concerns ab