Hi, We are using Spark on Amazon EMR 4.1. To access Spark web UI, we are using the link in yarn resource manager, but we are seeing a blank page on it. Further, using Firefox debugging we noticed that we got a HTTP 500 error in response.
We have tried configuring proxy settings for AWS and also replacing the internal hostname with external hostname/ip address but are still not able to access the web ui. The same steps worked for us in the past on EMR 3.x version. Any guidance would be helpful. Many Thanks, Sonal