Re: flink kafka producer avro serializer problem

2021-06-18 Thread Arvid Heise
Hi Kevin, Could you please expand why using Avro maps is not an option? [1] Of course, you wouldn't get some advantages like safe schema evolution but I can't see how that's supposed to work in your case anyways. Note that a map is also inefficient as keys are duplicated in each record. Dynamical

flink kafka producer avro serializer problem

2021-06-17 Thread Xin Ma
Hello, Currently, I am using confluent Kafka Avro serializer to write to Kafka, and in the meanwhile register the schema to confluent schema registry. The problem here is that our upstream is deserialized from msgpack and converted to a hashmap, which is not serializable for avro. The map include