DanielLeens opened a new pull request, #11206: URL: https://github.com/apache/seatunnel/pull/11206
### What changed - add `scan.newly-added-table.enabled` and `scan.binlog.newly-added-table.enabled` for MySQL CDC wildcard capture - convert Debezium create-table schema changes into SeaTunnel `CreateTableEvent` and keep the discovered table schema in sync - let `MultiTableSinkWriter` register per-table sink writers after job startup so runtime-created tables can flow into JDBC multi-table sinks - resolve JDBC runtime tables with the same database, naming, and primary-key rules as startup tables - add unit coverage and a targeted MySQL CDC E2E case for wildcard capture with a table created during the binlog phase ### Why MySQL CDC whole-database sync was still bounded by the startup table set. Even if the source discovered a new table later, the source-side schema event was not turned into a runtime sink registration path, so the new table could not be written without manual intervention. ### Validation - `./mvnw spotless:apply -Dskip.ui=true` - `./mvnw -pl seatunnel-api,seatunnel-connectors-v2/connector-cdc/connector-cdc-base,seatunnel-connectors-v2/connector-cdc/connector-cdc-mysql,seatunnel-connectors-v2/connector-jdbc,seatunnel-translation/seatunnel-translation-flink/seatunnel-translation-flink-common -am -DskipTests -Dskip.ui=true install` - `./mvnw -pl seatunnel-api -Dtest=MultiTableSinkWriterTest,EventTest test -Dskip.ui=true` - `./mvnw -pl seatunnel-connectors-v2/connector-cdc/connector-cdc-base -Dtest=SeaTunnelRowDebeziumDeserializeSchemaTest test -Dskip.ui=true` - `./mvnw -pl seatunnel-connectors-v2/connector-cdc/connector-cdc-mysql -Dtest=MySqlSourceConfigFactoryTest,MySqlSchemaTest test -Dskip.ui=true` - `./mvnw -pl seatunnel-connectors-v2/connector-jdbc -Dtest=JdbcSinkFactoryTest test -Dskip.ui=true` - `./mvnw -pl seatunnel-api,seatunnel-connectors-v2/connector-cdc/connector-cdc-base,seatunnel-connectors-v2/connector-cdc/connector-cdc-mysql,seatunnel-connectors-v2/connector-jdbc,seatunnel-translation/seatunnel-translation-flink/seatunnel-translation-flink-common -am -q -DskipTests -Dskip.ui=true verify` ### Additional notes - `seatunnel-engine-ui` was not changed and was skipped in local Maven verification. - I also attempted `./mvnw -pl seatunnel-e2e/seatunnel-connector-v2-e2e/connector-cdc-mysql-e2e -Dtest=MysqlCDCIT#testMysqlCdcByWildcardsConfigWithNewlyAddedTable test -Dskip.ui=true`, but the local Docker host could not allocate a new Testcontainers network (`all predefined address pools have been fully subnetted`). This is a host-level environment issue rather than a code failure. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
