Hi Saif, You need to run your application with `spark.eventLog.enabled` set to true. Then if you are using standalone mode, you can view the Master UI at port 8080. Otherwise, you may start a history server through `sbin/start-history-server.sh`, which by default starts the history UI at port 18080.
For more information on how to set this up, visit: http://spark.apache.org/docs/latest/monitoring.html -Andrew 2015-08-07 13:16 GMT-07:00 François Pelletier < newslett...@francoispelletier.org>: > > look at > spark.history.ui.port, if you use standalone > spark.yarn.historyServer.address, if you use YARN > > in your Spark config file > > Mine is located at > /etc/spark/conf/spark-defaults.conf > > If you use Apache Ambari you can find this settings in the Spark / Configs > / Advanced spark-defaults tab > > François > > > Le 2015-08-07 15:58, saif.a.ell...@wellsfargo.com a écrit : > > Hello, thank you, but that port is unreachable for me. Can you please > share where can I find that port equivalent in my environment? > > > > Thank you > > Saif > > > > *From:* François Pelletier [mailto:newslett...@francoispelletier.org > <newslett...@francoispelletier.org>] > *Sent:* Friday, August 07, 2015 4:38 PM > *To:* user@spark.apache.org > *Subject:* Re: Spark master driver UI: How to keep it after process > finished? > > > > Hi, all spark processes are saved in the Spark History Server > > look at your host on port 18080 instead of 4040 > > François > > Le 2015-08-07 15:26, saif.a.ell...@wellsfargo.com a écrit : > > Hi, > > > > A silly question here. The Driver Web UI dies when the spark-submit > program finish. I would like some time to analyze after the program ends, > as the page does not refresh it self, when I hit F5 I lose all the info. > > > > Thanks, > > Saif > > > > > > >
