Hi Flink team, We want to add customized metrics for measuring “user-facing/end-to-end latency” in Flink application. Per this post https://stackoverflow.com/questions/56578919/latency-monitoring-in-flink-application, the suggestion is to add a histogram metric in the sink operator myself, which depicts the difference between the current processing time and the event time to get a distribution of the event time lag at the source. However, how can I add this customized metric in sink operator?
I know I could adding the customized metrics using RichSinkFunction, but in this case, I cannot benefits from the internal Sink operators like DynamoDB sink https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/dynamodb/ And it’s also recommended to use these Internal Sink operations. Is there any way I could add histogram metric into Sink operators like DynamoDB sink? Thanks, Tengda This message is confidential and subject to terms at: https://www.jpmorgan.com/emaildisclaimer including on confidential, privileged or legal entity information, malicious content and monitoring of electronic messages. If you are not the intended recipient, please delete this message and notify the sender immediately. Any unauthorized use is strictly prohibited.
