Re: EOF on scraping flink metrics

2019-03-22 Thread Vishal Santoshi
Thank you, This is following https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/metrics.html#prometheus-orgapacheflinkmetricsprometheusprometheusreporter . What might I be doing wrong ? metrics.reporters: prom metrics.reporter.prom.port: 9610 . metrics.reporter.pr

Re: EOF on scraping flink metrics

2019-03-22 Thread Chesnay Schepler
Since you're using Prometheus I would recommend setting up a PrometheusReporter as described in the metrics documentation and scrape each JM/TM individually. Scraping through the REST API is more expensive and you loose out on a lot of features. The REST API calls are primarily aimed at the Web

EOF on scraping flink metrics

2019-03-22 Thread Vishal Santoshi
A simple query, Is the route to /metrics execute an access to an in memory registry of stats collected OR does it contend with access from JM or do expensive access or computation. I see occasionally our Prometheus scrape fail with the error pasted below. We have had the scrapper do much more el