Hongshun Wang created FLINK-38520:
-------------------------------------
Summary: Postgres YAML CDC support array with null element
Key: FLINK-38520
URL: https://issues.apache.org/jira/browse/FLINK-38520
Project: Flink
Issue Type: Improvement
Components: Flink CDC
Affects Versions: cdc-3.4.0
Reporter: Hongshun Wang
Fix For: cdc-3.6.0
Currently, if a null value in array, exception will occur:
{code:java}
java.lang.IllegalArgumentException: Unable convert multidimensional array value
'[null]' to a flat array. at
org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.convertToArray(DebeziumEventDeserializationSchema.java:519)
at
org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema$4.convert(DebeziumEventDeserializationSchema.java:248)
at
org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema$5.convert(DebeziumEventDeserializationSchema.java:563)
at
org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.convertField(DebeziumEventDeserializationSchema.java:462)
at
org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.convertToRecord(DebeziumEventDeserializationSchema.java:449)
at
org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema$2.convert(DebeziumEventDeserializationSchema.java:228)
at
org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema$5.convert(DebeziumEventDeserializationSchema.java:563)
at
org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.extractDataRecord(DebeziumEventDeserializationSchema.java:157)
at
org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.extractAfterDataRecord(DebeziumEventDeserializationSchema.java:152)
at
org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.deserializeDataChangeRecord(DebeziumEventDeserializationSchema.java:118)
at
org.apache.flink.cdc.debezium.event.SourceRecordEventDeserializer.deserialize(SourceRecordEventDeserializer.java:49)
at
org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.deserialize(DebeziumEventDeserializationSchema.java:105)
at
org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceRecordEmitter.emitElement(IncrementalSourceRecordEmitter.java:160)
at
org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceRecordEmitter.processElement(IncrementalSourceRecordEmitter.java:118)
at
org.apache.flink.cdc.connectors.postgres.source.reader.PostgresPipelineRecordEmitter.processElement(PostgresPipelineRecordEmitter.java:114)
at
org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceRecordEmitter.emitRecord(IncrementalSourceRecordEmitter.java:88)
at
org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceRecordEmitter.emitRecord(IncrementalSourceRecordEmitter.java:57)
at
org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:229)
at
org.apache.flink.streaming.api.operators.SourceOperator.pollNext(SourceOperator.java:806)
at
org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:484)
at
org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:70)
at
org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:68)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:706)
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
