Hi Xiuming,
> However, I am not sure if this option meets my need - is it possible to
obtain only the whole time spent between the source and the sink, without
the detailed time spent on each operator?
In framework, there is no possible to skip operators on the path. Just like
`watermark`, `Latenc
Hi Xiuming,
+1 on your idea.
BTW, Flink also provides a debug tool to track the latency of records
travelling through the system[1]. But you should note the following issue
if enable the latency tracking.
(1) It's a tool for debugging purposes because enabling latency metrics can
significantly impa
Hello community,
I would like to know how long it takes for an event to flow through the
whole Flink pipeline, that consumes from Kafka and sinks to Redis.
My current idea is, for each event:
1. calculate a start_time in source (timestamp field of [metadata](
https://ci.apache.org/projects/flink
