lvyanquan opened a new pull request, #4336: URL: https://github.com/apache/flink-cdc/pull/4336
[FLINK-39317] Add Source E2E with Flink 2.2
Summary
This PR adds support for running Source E2E tests with Flink 2.2,
introducing Maven profiles to switch between Flink 1.x and Flink 2.x
compatibility layers.
Changes
CI Configuration
- Add new source_e2e_2_x job in GitHub workflow to run Source E2E tests
with Flink 2.2.0
- Use -Pflink2 Maven profile for Flink 2.x compatibility
Maven Profiles
- Add flink1 profile (default) using flink-cdc-flink1-compat
- Add flink2 profile using flink-cdc-flink2-compat
- Update all SQL connector packages to include the appropriate
flink-cdc-flink*-compat artifact
Bug Fixes
- Fix paimon artifact version variable: change ${flink.major.version} to
${paimon.flink.major.version} in pipeline e2e tests
- Add missing createWriter(InitContext) method to StatefulSink interface
in flink2-compat module
Affected Connectors
All SQL connectors now include the flink-cdc-flink*-compat dependency:
- flink-sql-connector-mongodb-cdc
- flink-sql-connector-mysql-cdc
- flink-sql-connector-oceanbase-cdc
- flink-sql-connector-oracle-cdc
- flink-sql-connector-postgres-cdc
- flink-sql-connector-sqlserver-cdc
- flink-sql-connector-tidb-cdc
Test Plan
- Source E2E tests pass with Flink 1.x (default profile)
- Source E2E tests pass with Flink 2.2.0 (-Pflink2 profile)
- CI workflow runs successfully for both profiles
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
