Hi Attila, I checked the Section < https://spark.apache.org/docs/latest/monitoring.html#web-interfaces> and Web UI Page
What document is saying that if I want to view information only for the duration of the application, then I do not need to generate the event logs and do not need to set spark.eventLog.enabled=true and spark.eventLog.dir=<dir-name> . But If I want to see this info after the application completes , then I should persist the logs. My Requirement is to monitor the Executor Tab only during the Job run and not after. How can I see only during application run. Regards Ranju -----Original Message----- From: Attila Zsolt Piros <[email protected]> Sent: Wednesday, March 3, 2021 10:37 PM To: [email protected] Subject: RE: Spark Version 3.0.1 Gui Display Query Hi Ranju! The UI is built up from events. This is why history server able to show the state of the a finished app as those events are replayed to build a state, for details you can check web UI page and the following section too < https://spark.apache.org/docs/latest/monitoring.html#web-interfaces> . So you should share/look into the event log. Regards, Attila -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe e-mail: [email protected]
