Re: How to calculate how long an event stays in flink?

2021-07-03 Thread JING ZHANG
Hi Xiuming, > However, I am not sure if this option meets my need - is it possible to obtain only the whole time spent between the source and the sink, without the detailed time spent on each operator? In framework, there is no possible to skip operators on the path. Just like `watermark`, `Latenc

Re: How to calculate how long an event stays in flink?

2021-07-01 Thread JING ZHANG
Hi Xiuming, +1 on your idea. BTW, Flink also provides a debug tool to track the latency of records travelling through the system[1]. But you should note the following issue if enable the latency tracking. (1) It's a tool for debugging purposes because enabling latency metrics can significantly impa