Darcy Lin created FLINK-37848:
---------------------------------
Summary: After timestamp mode is enabled, newly added tables will
not have all their data synchronized.
Key: FLINK-37848
URL: https://issues.apache.org/jira/browse/FLINK-37848
Project: Flink
Issue Type: Bug
Components: Flink CDC
Affects Versions: cdc-3.4.0
Reporter: Darcy Lin
If a synchronization task is started using a timestamp, then even if
scan.startup.mode is set to initial, only a MysqlBinlogSplitAssigner-type
SplitAssigner can be generated during state recovery, and a
MysqlHybridSplitAssigner-type SplitAssigner can never be generated. The logic
for snapshotting and binlog processing of newly added tables in the CDC
configuration file exists only in MysqlHybridSplitAssigner. As a result, if a
task is started with a stateless timestamp, there is no way to perform snapshot
synchronization of historical data for newly added tables, leading to data
inconsistency in the newly added tables.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
