[ https://issues.apache.org/jira/browse/FLINK-18758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17322984#comment-17322984 ]
Flink Jira Bot commented on FLINK-18758: ---------------------------------------- This issue is assigned but has not received an update in 7 days so it has been labeled "stale-assigned". If you are still working on the issue, please give an update and remove the label. If you are no longer working on the issue, please unassign so someone else may work on it. In 7 days the issue will be automatically unassigned. > Many data types do not work in debezium format > ----------------------------------------------- > > Key: FLINK-18758 > URL: https://issues.apache.org/jira/browse/FLINK-18758 > Project: Flink > Issue Type: Sub-task > Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile) > Reporter: Leonard Xu > Assignee: Jark Wu > Priority: Major > Labels: stale-assigned > > Currently debezium json format wrapper the json format to > serialize/deserialize the debezuim json format data. > But debezium json format has its own data type which consists of Literal Type > and Semantic Type[1], i.g. Date type in debezium is an integer which > represents the number of days since epoch rather than a string with > 'yyyy-MM-dd' pattern. > {code:java} > { "schema":{ > "fields":[ > { > "fields":[ > { > "type":"int32", //Literal Type > "optional":false, > "name":"io.debezium.time.Date", //semantic Type > "version":1, > "field":"order_date" > }, > { "type":"int32", > "optional":false, > "field":"quantity" > } > ] > } > ] > }, > "payload":{ > "before":null, > "after":{ > "order_date":16852, // Literal Value, the number of days since epoch > "quantity":1 > }, > "op":"c", > "ts_ms":1596081813474 > } > } {code} > > I think we need obtain the debezuim data type from schema information and > then serialize/deserialize the data in payload. > [1][https://debezium.io/documentation/reference/1.2/connectors/mysql.html] > -- This message was sent by Atlassian Jira (v8.3.4#803005)