MOBIN created FLINK-36858: ----------------------------- Summary: [pipeline-kafka] JsonRowDataSerializationSchema compatibility bug Key: FLINK-36858 URL: https://issues.apache.org/jira/browse/FLINK-36858 Project: Flink Issue Type: Bug Components: Flink CDC Affects Versions: cdc-3.2.1 Reporter: MOBIN Attachments: image-2024-12-06-15-20-02-727.png
minimum repetition step: Flink 1.20 Flink cdc master {code:java} source: type: mysql name: MySQL Source hostname: localhost port: 3306 username: test password: test tables: testDB.testTable server-id: 5206 server-time-zone: Asia/Shanghai schema-change.enabled: true sink: type: kafka name: Kafka Sink properties.bootstrap.servers: localhost:9092 topic: test_topic pipeline: name: MySQL to Kafka Pipeline parallelism: 1 {code} error message: {code:java} Caused by: java.lang.NoSuchMethodError: 'void org.apache.flink.formats.json.JsonRowDataSerializationSchema.<init>(org.apache.flink.table.types.logical.RowType, org.apache.flink.formats.common.TimestampFormat, org.apache.flink.formats.json.JsonFormatOptions$MapNullKeyMode, java.lang.String, boolean)' at org.apache.flink.cdc.connectors.kafka.serialization.JsonSerializationSchema.buildSerializationForPrimaryKey(JsonSerializationSchema.java:134) at org.apache.flink.cdc.connectors.kafka.serialization.JsonSerializationSchema.serialize(JsonSerializationSchema.java:101) at org.apache.flink.cdc.connectors.kafka.serialization.JsonSerializationSchema.serialize(JsonSerializationSchema.java:47) at org.apache.flink.cdc.connectors.kafka.sink.PipelineKafkaRecordSerializationSchema.serialize(PipelineKafkaRecordSerializationSchema.java:99) at org.apache.flink.cdc.connectors.kafka.sink.PipelineKafkaRecordSerializationSchema.serialize(PipelineKafkaRecordSerializationSchema.java:44) {code} Cause of error: The JsonRowDataSerializationSchema constructor of Flink 1.20 has an additional ignoreNullFields parameter, which causes this [part of the code|https://github.com/apache/flink-cdc/blob/ee9cd828c3ba822570cb349f7ce978234086aeb6/flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-kafka/src/main/java/org/apache/flink/cdc/connectors/kafka/serialization/JsonSerializationSchema.java#L134] to throw a NoSuchMethodError !image-2024-12-06-15-20-02-727.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)