Hi guys,
I was trying to use flink sql to consume data from kafka source, the format of which is debezium-avro-confluent. And I encountered a AvroTypeException saying that "Found something, expecting union", where something is not a type but a field that I defined in the schema registery. So I looked into the source code and what I found in org.apache.flink.formats.avro.registry.confluent.debezium.DebeziumAvroDeserializationSchema.createDebeziumAvroRowType was a segement of comment saying that "Debezium Avro contains other information, e.g. "source", "ts_ms", but we don't need them". I am wondering why don't we need it? Both source and ts_ms are in my schema, and I assume that the absence of source and ts_ms caused the exception described above. I am using Flink 1.15. Any help would be highly appreciated! Thanks!