[ 
https://issues.apache.org/jira/browse/FLINK-36996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17909333#comment-17909333
 ] 

Thorne commented on FLINK-36996:
--------------------------------

I will fix it 

> The schema and namespace of MySQL pipeline connector metadata are reversed
> --------------------------------------------------------------------------
>
>                 Key: FLINK-36996
>                 URL: https://issues.apache.org/jira/browse/FLINK-36996
>             Project: Flink
>          Issue Type: Bug
>          Components: Flink CDC
>         Environment: flink :1.18.0
> flink-cdc 3.2.1
> doris:2.1
>            Reporter: Thorne
>            Priority: Major
>             Fix For: cdc-3.3.0
>
>         Attachments: image-2025-01-02-23-36-53-097.png, 
> image-2025-01-02-23-44-28-707.png, image-2025-01-02-23-47-31-644.png
>
>
> As show that :
> 1、mysql2doris yaml with metadata config
> {code:java}
> //代码占位符
> ################################################################################
> # Description: Sync MySQL all tables to Doris
> ################################################################################
> source:
>   type: mysql
>   hostname: localhost
>   port: 3306
>   username: root
>   password: 123456
>   tables: app_db.\.*
>   server-id: 5400-5404
>   server-time-zone: UTC
> sink:
>   type: doris
>   fenodes: 127.0.0.1:8030
>   username: root
>   password: ""
>   table.create.properties.light_schema_change: true
>   table.create.properties.replication_num: 1
> transform:  
>   - source-table: app_db.orders    
>     projection: \*, __namespace_name__  as dbname, __schema_name__  as 
> schema_name, __table_name__  as tb_name    
>     description: access metadata columns from source table  pipeline:
>   name: Sync MySQL Database to Doris
>   parallelism: 2
> {code}
> 2、The select results from doris's app_db.orders table will be show that 
> dbname column is null and schema_name is not empty.
> !image-2025-01-02-23-44-28-707.png|width=647,height=258!
>  
> 3、we can see that we get the wrong results because of the flink-cdc's  
> [Metadata 
> relationship|https://nightlies.apache.org/flink/flink-cdc-docs-master/docs/core-concept/transform/#metadata-relationship]
>  !image-2025-01-02-23-47-31-644.png|width=594,height=370!
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to