[ https://issues.apache.org/jira/browse/FLINK-32712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17748818#comment-17748818 ]
yuan commented on FLINK-32712: ------------------------------ I raised a PR in response to this question, has anyone review this PR? https://github.com/apache/flink/pull/23102 > Enhance Flink ogg-json format > ----------------------------- > > Key: FLINK-32712 > URL: https://issues.apache.org/jira/browse/FLINK-32712 > Project: Flink > Issue Type: Bug > Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile) > Affects Versions: 1.17.1 > Reporter: yuan > Priority: Major > Labels: pull-request-available > > The BEFORE field in ogg-json can be configured to contain no table fields, as > in the ogg-json example below. > {code:java} > { > "table": "ZBZZZ", > "op_type": "U", > "op_ts": "2023-07-20 21:45:34.860817", > "current_ts": "2023-07-21T05:45:36.615000", > "pos": "00002564940142073691", > "before": {}, > "after": { > "ID": 1461242, > "PROPERTY_01": "tc", > "PROPERTY_02": null, > "PROPERTY_03": null, > "PROPERTY_04": "K", > "PROPERTY_05": "5", > "PROPERTY_06": null, > "PROPERTY_07": null, > "PROPERTY_08": null, > "PROPERTY_09": null, > "PROPERTY_10": null > } > }{code} > For this case, ogg-json format should not send a Record of type UPDATE_BEFORE > downstream。 Worse, it can sometimes cause the flink job to crash out. > -- This message was sent by Atlassian Jira (v8.20.10#820010)