Re: A query on Flink metrics in kubernetes

From Flink's perspective no metrics are aggregated, nor are metric requests forwarded to some other process. Each TaskExecutor has its own reporter, that each must be scraped to get the full set of metrics. On 09/07/2020 11:39, Manish G wrote: Hi, I have a query regarding prometheus scrapin

A query on Flink metrics in kubernetes

Hi, I have a query regarding prometheus scraping Flink metrics data with application running in kubernetes cluster. If taskmanager is running on multiple nodes, and prometheus requests for the metrics data, then is that request directed to one of the nodes(based on some strategy, like round-robin

Re: Flink Metrics in kubernetes

Hi Gary, Sorry for the false alarm. It's caused by a bug in my deployment - no metrics were added into the registry. Sorry for wasting your time. Thanks and best regards, Averell -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Flink Metrics in kubernetes

Hi Gary, Thanks for the help. Here below is the output from jstack. It seems not being blocked. In my JobManager log, there's this WARN, I am not sure whether it's relevant at all. Attached is the full jstack dump k8xDump.txt

Re: Flink Metrics in kubernetes

Hi Averell, If you are seeing the log message from [1] and Scheduled#report() is not called, the thread in the "Flink-MetricRegistry" thread pool might be blocked. You can use the jstack utility to see on which task the thread pool is blocked. Best, Gary [1] https://github.com/apache/flink/blob

Flink Metrics in kubernetes

Hi, I'm trying to config Flink running in Kubernetes native to push some metrics to NewRelic (using a custom ScheduledDropwizardReporter). >From the logs, I could see that an instance of ScheduledDropwizardReporter has already been created successfully (the overridden getReporter() method

Re: Flink metrics in kubernetes deployment

If you're working with 1.7/master you're probably running into https://issues.apache.org/jira/browse/FLINK-11127 . On 17.12.2018 18:12, eric hoffmann wrote: Hi, In a Kubernetes delpoyment, im not able to display metrics in the dashboard, I try to expose and fix the metrics.internal.query-servi

Flink metrics in kubernetes deployment

Hi, In a Kubernetes delpoyment, im not able to display metrics in the dashboard, I try to expose and fix the metrics.internal.query-service.port variable But nothing. Do you have any ideas? Thx Eric