tianfy created FLINK-39171:
------------------------------
Summary: Oracle pipeline transform fails with quoted uppercase
projection columns
Key: FLINK-39171
URL: https://issues.apache.org/jira/browse/FLINK-39171
Project: Flink
Issue Type: Improvement
Components: Flink CDC
Affects Versions: cdc-3.6.0
Environment: * Flink: 1.20.1
* Oracle: 19c (Non-CDB,)
* Startup mode: {{initial}}
* Flink CDC：3.6.0
Reporter: tianfy
In Oracle CDC *pipeline mode*, transform projection can fail when projection
uses quoted uppercase source columns (for example {{`ID`}}), with:
{{Column 'ID' not found in any table}}
Observed behavior suggests Oracle pipeline schema columns are normalized to
lowercase internally (for example {{id}}), while transform SQL validation
treats quoted identifiers as exact/case-sensitive, causing mismatch.
This does not reproduce in our non-pipeline Oracle CDC source path.
h3. Reproduction
# Create Oracle table (unquoted column names, Oracle stores as uppercase):
** {{TESTUSER.ORDERS(ID, PRODUCT_ID, QUANTITY, UPDATED_AT)}}
# Run Oracle pipeline with transform projection using quoted uppercase source
columns, e.g.:
pipeline:
schema.change.behavior: LENIENT
transform:
- source-table: ORCL19.TESTUSER.ORDERS
primary-keys: id
projection: "`ID` as `id`,`PRODUCT_ID` as `product_id`,`QUANTITY` as
`quantity`,`UPDATED_AT` as `updated_at`"
source:
type: oracle
database: ORCL19
tables: ORCL19.TESTUSER.ORDERS
scan.startup.mode: initial
3. Start the job.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
