> I have done this (actually I do it in my flink-conf.yaml), but I am not seeing any metrics at all in the Flink UI, > let alone the latency tracking. The latency tracking itself does not seem to be exported to datadog (should it be?)
The latency metrics are job metrics, and are not shown in the Flink UI. They are available via the REST API, and I believe they should also be exported to datadog. You will find them at http://localhost:8081/jobs/<job id>/metrics with IDs like latency.source_id.bc764cd8ddf7a0cff126f51c16239658.operator_id.ea632d67b7d595e5b851708ae9ad79d6.operator_subtask_index.0.latency_p90 On Sat, Mar 23, 2019 at 1:53 PM Padarn Wilson <pad...@gmail.com> wrote: > Thanks David. > > I have done this (actually I do it in my flink-conf.yaml), but I am not > seeing any metrics at all in the Flink UI, let alone the latency tracking. > The latency tracking itself does not seem to be exported to datadog (should > it be?) > > > > On Sat, Mar 23, 2019 at 8:43 PM David Anderson <da...@ververica.com> > wrote: > >> Because latency tracking is expensive, it is turned off by default. You >> turn it on by setting the interval; that looks something like this: >> >> env.getConfig().setLatencyTrackingInterval(1000); >> >> The full set of configuration options is described in the docs: >> https://ci.apache.org/projects/flink/flink-docs-stable/ops/config.html#metrics >> >> David Anderson | Training Coordinator >> Follow us @VervericaData >> >> -- >> Join Flink Forward - The Apache Flink Conference >> Stream Processing | Event Driven | Real Time >> >> >> On Sat, Mar 23, 2019 at 1:03 PM Padarn Wilson <pad...@gmail.com> wrote: >> > >> > Hi User, >> > >> > I am running Fink 1.7.2 on Kubernetes in a setup with task manager and >> job manager separate. >> > >> > I'm having trouble seeing the metrics from my Flink job in the UI >> dashboard. Actually I'm using the Datadog reporter to expose most of my >> metrics, but latency tracking does not seem to be exported. >> > >> > Is there anything extra that needs to be enabled to make sure metrics >> are exported and viewable to the Flink UI? >> > >> > Thanks >> >>>