Flink Metric Naming And Reporting Confusion

2023-02-17 Thread Saad Mufti
Hi, My team just started coding a new Flink app to be deployed under AWS EMR. We are a little confused by the metric naming for built in metrics (not ones we create ourselves) and reporting of metrics via StatsD. We have added configuration to flink-conf.yaml to configure a StatsD reporter. This

Re: KafkaSink handling message size produce errors

2023-02-17 Thread Jing Ge via user
ticket created: https://issues.apache.org/jira/browse/FLINK-31121 On Fri, Feb 17, 2023 at 9:59 AM Hatem Mostafa wrote: > Thanks for adding this to your backlog, I think it's definitely a very > useful feature. > > Can you provide an example for how to extend KafkaSink to > add this error handlin

Re: KafkaSink handling message size produce errors

2023-02-17 Thread Hatem Mostafa
Thanks for adding this to your backlog, I think it's definitely a very useful feature. Can you provide an example for how to extend KafkaSink to add this error handling? I have tried to do so but did not find it straight forward, since errors are thrown in the deliveryCallback of KafkaWriter and K