Re: java.lang.Object serialization by Kryo

2024-11-08 Thread Kirill Ternovsky
Hello, I've had good luck implementing `Value` to have Flink (1.19, not sure about earlier versions) use my custom serialization code for a particular type. More details in the docs here: https://nightlies.apache.org/flink/flink-docs-release-1.19/docs/dev/datastream/fault-tolerance/serializati

A bug in upsert Kafka 3.3.0 & Flink 1.20?

2024-11-08 Thread Daniele Parmeggiani
Hello 👋 We're trying out the new 1.20 version of Flink and the 3.3.0 Kafka upsert connector with SQL and we're hitting some problems. We've been using the 3.1.0 version with Flink 1.18 so far, and it's been working properly for us. When upgrading one of our jobs, without changing the SQL code, w

java.lang.Object serialization by Kryo

2024-11-08 Thread Kamal Mittal via user
Hello, java.lang.Object is serialized by Kryo as it is taken as generic data type by Flink. Is there any way to switch it to some other serializer for performance improvement or not? Also can you please give some documentation for reference around it? I profiled my application and then found