Re: Spark Executor Metrics

Hi Muhammad, You should give people a bit more time to answer/help you (for free). :) I don't have direct answer for you, but you can look at SPM for Spark , which has all the instructions for getting all Spark metrics (Executors, etc

Re: Spark Executor Metrics

Still waiting for response, any clue/suggestions? On Tue, Aug 16, 2016 at 4:48 PM, Muhammad Haris < muhammad.haris.makh...@gmail.com> wrote: > Hi, > I have been trying to collect driver, master, worker and executors metrics > using Spark 2.0 in standalone mode, here is what my metrics configurat

Spark Executor Metrics

Hi, I have been trying to collect driver, master, worker and executors metrics using Spark 2.0 in standalone mode, here is what my metrics configuration file looks like: *.sink.csv.class=org.apache.spark.metrics.sink.CsvSink *.sink.csv.period=1 *.sink.csv.unit=seconds *.sink.csv.directory=/root/me