look at spark.history.ui.port, if you use standalone spark.yarn.historyServer.address, if you use YARN
in your Spark config file Mine is located at /etc/spark/conf/spark-defaults.conf If you use Apache Ambari you can find this settings in the Spark / Configs / Advanced spark-defaults tab François Le 2015-08-07 15:58, saif.a.ell...@wellsfargo.com a écrit : > > Hello, thank you, but that port is unreachable for me. Can you please > share where can I find that port equivalent in my environment? > > > > Thank you > > Saif > > > > *From:*François Pelletier [mailto:newslett...@francoispelletier.org] > *Sent:* Friday, August 07, 2015 4:38 PM > *To:* user@spark.apache.org > *Subject:* Re: Spark master driver UI: How to keep it after process > finished? > > > > Hi, all spark processes are saved in the Spark History Server > > look at your host on port 18080 instead of 4040 > > François > > Le 2015-08-07 15:26, saif.a.ell...@wellsfargo.com > <mailto:saif.a.ell...@wellsfargo.com> a écrit : > > Hi, > > > > A silly question here. The Driver Web UI dies when the > spark-submit program finish. I would like some time to analyze > after the program ends, as the page does not refresh it self, when > I hit F5 I lose all the info. > > > > Thanks, > > Saif > > > > >
