There is the PR https://github.com/apache/spark/pull/2077 for doing this.
On Fri, Mar 13, 2015 at 6:42 AM, t1ny <wbr...@gmail.com> wrote: > Hi all, > > We are looking for a tool that would let us visualize the DAG generated by > a > Spark application as a simple graph. > This graph would represent the Spark Job, its stages and the tasks inside > the stages, with the dependencies between them (either narrow or shuffle > dependencies). > > The Spark Replay Debugger ( > http://spark-replay-debugger-overview.readthedocs.org/en/latest > <http://spark-replay-debugger-overview.readthedocs.org/en/latest/> /) > seemed like a perfect tool for this, unfortunately it doesn't seem to be > maintained anymore. > > What is the state of the Spark Replay Debugger ? Has this project been > "dropped" or has it in fact been ported to the latest versions of Spark ? > Is there any other similar tool out there that we could use ? > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Visualizing-the-DAG-of-a-Spark-application-tp22033.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
