RE: [DISCUSS][CORE] Exposing application status metrics via a source

2018-09-14 Thread Luca Canali
, September 12, 2018 22:35 To: Dev Subject: [DISCUSS][CORE] Exposing application status metrics via a source Hi all, I have a PR https://github.com/apache/spark/pull/22381 that exposes application status metrics (related jira: SPARK-25394). So far metrics tooling needs to scrape the metrics rest api

[DISCUSS][CORE] Exposing application status metrics via a source

2018-09-12 Thread Stavros Kontopoulos
Hi all, I have a PR https://github.com/apache/spark/pull/22381 that exposes application status metrics (related jira: SPARK-25394). So far metrics tooling needs to scrape the metrics rest api to get metrics like job delay, stages failed, stages completed etc. >From devops perspective it is good t