Hi, I would like to monitor the pipeline latency measured by timestamp when writing the output to sink - timestamp when ingested from the source.
Now I'm able to get the timestamp writing to sink since the sink is implementing a RichSinkFunction and therefore I can report gauge there [1]. But I have no idea on how to get the source ingestion timestamp since I use Flink SQL create table DDL [2] to create a table and use Flink SQL for the logic. I also checked [3] which is not recommended for prod use cases. Any suggestions? Thanks, Fanbin [1] https://ci.apache.org/projects/flink/flink-docs-release-1.12/ops/metrics.html#gauge [2] https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/table/sql/create.html#create-table [3] https://ci.apache.org/projects/flink/flink-docs-release-1.12/ops/metrics.html#latency-tracking
