Re: WebUI on yarn through ssh tunnel affected by AmIpfilter

Instead of opening a tunnel to the Spark web ui port, could you open a tunnel to the YARN RM web ui instead? That should allow you to navigate to the Spark application's web ui through the RM proxy, and hopefully that will work better. On Fri, Feb 6, 2015 at 9:08 PM, yangqch wrote: > Hi folks, >

Re: WebUI on yarn through ssh tunnel affected by AmIpfilter

I ran into a similar issue. What's happening is that when Spark is running in YARN client mode, YARN automatically launches a Web Application Proxy to reduce hacking attempts. In doing so, it

Re: WebUI on yarn through ssh tunnel affected by AmIpfilter

Just to add why tunneling is not a good practice sometime: There could be some other ports/apps depeneding on other processes running on different ports. Lets say a web app running on port 8080 pulling info from other processes through rest api which will fail here since you only tunnel for 8080 a

Re: WebUI on yarn through ssh tunnel affected by AmIpfilter

Just make sure all ports (0-65535) are accessible across your cluster. And you may also want to open these ports for your IP address instead of tunneling: 8080, 8081, 18080, 1, 50030, 50070, 60070, 4040-4045 Thanks Best Regards On Sat, Feb 7, 2015 at 10:38 AM, yangqch wrote: > Hi folks, >