Hi Morgan,
did you see this:
https://stackguides.com/questions/68917956/read-flink-latency-tracking-metric-in-datadog
Also `metrics.latency.granularity` must be set in the Flink
configuration. Not sure if `-D` forwards this properly.
Timo
On 10.12.21 18:31, Geldenhuys, Morgan Karl wrote:
Greetings all,
I am attempting to setup latency monitoring for a flink 1.14.0 job.
According to the documentation
<https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/ops/metrics/>,
I have done the following:
In my kubernetes setup I have added the following to the
kubernetes-session.sh command:
-Dmetrics.latency.granularity=\"operator\" \
-Dmetrics.latency.interval=1000 \
However, when looking at Prometheus, I do not see histograms related to
latency (prometheus is configured correctly).
I have added the following to my job pom and am using the new
KafkaSource/KafkaSink classes:
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.11</artifactId>
<version>1.14.0</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId>
<version>1.14.0</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-kafka_2.11</artifactId>
<version>1.14.0</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-statebackend-rocksdb_2.11</artifactId>
<version>1.14.0</version>
</dependency>
Would really appreciate some help here. Thanks in advance!
Regards,
Morgan.
