Hello, when running spark jobs, I can access the master UI (port 8080 one) no problem. However, I'm confused as to how to access the web UI to see jobs/tasks/stages/etc.
I can access the master UI at http://<master-node>:8080. But port 4040 gives me a -connection cannot be reached-. Is the web UI http://<master-node> with a port of 4040? I'm running my Spark job on a cluster machine and submitting it to a master node part of the cluster. I heard of ssh tunneling; is that relevant here? Thank you!
