An Operator like below will expose lag between current time and event time
passing the operator. I add that after the source and before the sink, and
calculate sink_delay - source_delay in grafana. would that be a generic
solution to solve the problem?
```
public class EmitLagOperator extends Abstr
Hi,
I think we may add latency metric for each operator, which can reflect
consumption ability of each operator.
Best,
Dan Zou
> 在 2020年3月30日，18:19，Guanghui Zhang 写道：
>
> Hi.
> At flink source connector, you can send $source_current_time - $event_time
> metric.
> In the meantime, at flink si
Hi.
At flink source connector, you can send $source_current_time - $event_time
metric.
In the meantime, at flink sink connector, you can send $sink_current_time -
$event_time metric.
Then you use $sink_current_time - $event_time - ($source_current_time -
$event_time) = $sink_current_time - $source
On Mon, 30 Mar 2020 at 05:08, Lu Niu wrote:
> $current_processing - $event_time works for event time. How about
> processing time? Is there a good way to measure the latency?
>
To measure latency you'll need some way to determine the time spent between
the start and end of your pipeline.
To mea
Time:2020 Mar. 28 (Sat.) 11:49
> To:Lu Niu
> Cc:user
> Subject:Re: End to End Latency Tracking in flink
>
> Hi
> As far as I know, the latency-tracking feature is for debugging usages,
> you can use it to debug, and disable it when running the job on production.
> From my side, u
me:2020 Mar. 28 (Sat.) 11:49
To:Lu Niu
Cc:user
Subject:Re: End to End Latency Tracking in flink
Hi
As far as I know, the latency-tracking feature is for debugging usages, you can
use it to debug, and disable it when running the job on production.
From my side, use $current_processing - $event_time
Hi
As far as I know, the latency-tracking feature is for debugging usages, you
can use it to debug, and disable it when running the job on production.
>From my side, use $current_processing - $event_time is something ok, but
keep the things in mind: the event time may not be the time ingested in
Fl
Hi,
I am looking for end to end latency monitoring of link job. Based on my
study, I have two options:
1. flink provide a latency tracking feature. However, the documentation
says it cannot show actual latency of business logic as it will bypass all
operators.
https://ci.apache.org/projects/flink
