Hi, I know nothing about Spark in GCP so answering this for a pure Spark.
Can you use web UI and Executors tab or a SparkListener? Jacek On 7 Feb 2017 5:33 p.m., "Anahita Talebi" <anahita.t.am...@gmail.com> wrote: Hello Friends, I am trying to run a spark code on multiple machines. To this aim, I submit a spark code on submit job on google cloud platform. https://cloud.google.com/dataproc/docs/guides/submit-job I have created a cluster with 6 nodes. Does anyone know how I can realize which nodes are participated when I run the code on the cluster? Thanks a lot, Anahita