Re: Export user metrics with Flink Prometheus endpoint

2020-05-18 Thread Eleanore Jin
Hi Aljoscha, Thanks a lot for the suggestion! Best, Eleanore On Mon, May 18, 2020 at 2:16 AM Aljoscha Krettek wrote: > Now I see what you mean. I think you would have to somehow set up the > Flink metrics system as a backend for opencensus. Then the metrics would > be reported to the same syst

Re: Export user metrics with Flink Prometheus endpoint

2020-05-18 Thread Aljoscha Krettek
Now I see what you mean. I think you would have to somehow set up the Flink metrics system as a backend for opencensus. Then the metrics would be reported to the same system (prometheus) in this case. In Opencensus lingo, this would mean using a Flink-based Stats Exporter instead of the Prometh

Re: Export user metrics with Flink Prometheus endpoint

2020-05-06 Thread Eleanore Jin
Hi Aljoscha, Thanks for the response, yes prometheus reporter is already enabled and I am able to get the flink metrics from prometheus. My question is more like, currently I am using opencensus library to collect application metrics, so

Re: Export user metrics with Flink Prometheus endpoint

2020-05-06 Thread Aljoscha Krettek
Hi, that should be possible. Did you have a look at the documentation for setting up a Prometheus metrics reporter: https://ci.apache.org/projects/flink/flink-docs-master/monitoring/metrics.html#prometheus-orgapacheflinkmetricsprometheusprometheusreporter Best, Aljoscha On 06.05.20 03:02, El

Export user metrics with Flink Prometheus endpoint

2020-05-05 Thread Eleanore Jin
Hi all, I just wonder is it possible to use Flink Metrics endpoint to allow Prometheus to scrape user defined metrics? Context: In addition to Flink metrics, we also collect some application level metrics using opencensus. And we run opencensus agent as side car in kubernetes pod to collect metri