Hongshun Wang created FLINK-41058:
-------------------------------------
Summary: Fluss pipeline sink ignores table options defined in
transform rules
Key: FLINK-41058
URL: https://issues.apache.org/jira/browse/FLINK-41058
Project: Flink
Issue Type: New Feature
Components: Flink CDC
Affects Versions: cdc-3.7.0
Reporter: Hongshun Wang
Fix For: cdc-3.8.0
The Fluss pipeline sink currently ignores {{table-options}}?? ??configured in
transform rules when automatically creating tables.
Transform rules propagate these options through {{{}Schema.options(){}}}.
However, {{FlussMetaDataApplier}} only uses the global {{properties.table.*}}
options from the sink configuration. The Paimon sink already merges both
sources.
For example,
{code:java}
transform:
- source-table: inventory.products
projection: "*"
table-options: table.replication.factor=2,table.log.ttl=7d
sink:
type: fluss
bootstrap.servers: localhost:9123
properties.table.replication.factor: 3 {code}
Expected behavior:
* The table created for inventory.products has a replication factor of 2 and a
log retention time of 7 days.
* Table-specific options override matching global sink options.
* Other global options remain effective, and other tables are unaffected.
Actual behavior:
* The table uses the global replication factor of 3.
* The transform-defined log retention setting is ignored.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
