Re: A way to meter number of deserialization errors

2024-06-21 Thread Ilya Karpov
I guess metering deserialization errors may be done by flink metrics, but now it is missing out of the box. > - I wondered if you might also want to count how many were successfully > parsed in a non-protobuf layer (Dynamic table sort of level) No, this is not a requirement. I have a simple flink

Re: A way to meter number of deserialization errors

2024-06-19 Thread David Radley
Hi Ilya, I have not got any experience of doing this, but wonder if we could use the Flink Metrics . I wonder: - There could be hook point at that part of the code to discover some custom code that implements the metrics.

Re: A way to meter number of deserialization errors

2024-06-19 Thread Ilya Karpov
Does anybody experience the problem of metering deserialization errors? пн, 17 июн. 2024 г. в 14:39, Ilya Karpov : > Hi all, > we are planning to use flink as a connector between kafka and > external systems. We use protobuf as a message format in kafka. If > non-backward compatible changes occur