Re: Seeing Rocks Native Metrics in Data Dog

AFAIK all IDs (and in fact all variables except ) are exposed as tags. (the is transmitted separately and I would've though Datadog automatically provides similar functionality for it). On 1/27/2021 2:11 AM, Rex Fenley wrote: Oddly, I'm seeing them now. I'm not sure what has changed. Fwiw, we

Re: Seeing Rocks Native Metrics in Data Dog

Oddly, I'm seeing them now. I'm not sure what has changed. Fwiw, we have modified the scopes per https://docs.datadoghq.com/integrations/flink/#metric-collection but their modifications ids as tags. We do need to modify them according to that documentation - "*Note*: The system scopes must be remap

Re: Seeing Rocks Native Metrics in Data Dog

It is good to know that something from the task executors arrives at datadog. Do you see any metrics for a specific job, like the numRestarts metric of the JobManager? Are you using the default scope formats

Re: Seeing Rocks Native Metrics in Data Dog

All taskmanager and jobmanager logs show up. Anything specific to an operator does not. For example, flink.taskmanager.Status.JVM.Memory.Heap.Used shows up, but I can't see stats on an individual operator. I mostly followed a combination of https://docs.datadoghq.com/integrations/flink/#metric-col

Re: Seeing Rocks Native Metrics in Data Dog

Anything metric that is shown in the Flink UI should also appear in DataDog. If this is not the case then something goes wrong within the reporter. Is there anything suspicious in the Flink logs? Can you give some example of metrics that /do/ show up in DataDog? On 1/26/2021 6:32 PM, Rex Fenley

Seeing Rocks Native Metrics in Data Dog

Hi, I need to get a deeper dive into how rocks is performing so I turned on Rocks Native Metrics. However, I don't see any of the metrics in DataDog (though I have other Flink metrics in DataDog). I only see rocks metrics in the operator metrics in Flink UI, and unfortunately I can't really zoom i