Ah, yes, it will use private IPs, so you may need to update your FoxyProxy settings to include the private IPs in the regex as well as the public IPs.
Also, yes, for completed applications you may use the Spark History Server on port 18080. The YARN ProxyServer will automatically redirect to the Spark History Server once a job has completed, so you can still start from the YARN ResourceManager. In the case of completed applications, the link on the YARN ResourceManager will be "History" instead of "ApplicationMaster". ~ Jonathan On Wed, Oct 14, 2015 at 12:57 AM, Joshua Fox <jos...@twiggle.com> wrote: > Thank you! > > It seems that the the history server at port 18080 also gives access to > the Spark GUI as below > > Following your tip, I see that the YARN ResourceManager GUI on 8088 > indeed has that ApplicationMaster link, though to a private rather than > public IP; replacing IPs brings me to the same Spark GUI. > > Joshua > [image: Inline image 3] > > > > > On Tue, Oct 13, 2015 at 6:23 PM, Jonathan Kelly <jonathaka...@gmail.com> > wrote: > >> Joshua, >> >> Since Spark is configured to run on YARN in EMR, instead of viewing the >> Spark application UI at port 4040, you should instead start from the YARN >> ResourceManager (on port 8088), then click on the ApplicationMaster link >> for the Spark application you are interested in. This will take you to the >> YARN ProxyServer on port 20888, which will proxy you through to the Spark >> UI for the application (which renders correctly when viewed this way). This >> works even if the Spark UI is running on a port other than 4040 and even in >> yarn-cluster mode when the Spark driver is running on a slave node. >> >> Hope this helps, >> Jonathan >> >> On Tue, Oct 13, 2015 at 7:19 AM, Jean-Baptiste Onofré <j...@nanthrax.net> >> wrote: >> >>> Thanks for the update Joshua. >>> >>> Let me try with Spark 1.4.1. >>> >>> I keep you posted. >>> >>> Regards >>> JB >>> >>> On 10/13/2015 04:17 PM, Joshua Fox wrote: >>> >>>> * Spark 1.4.1, part of EMR emr-4.0.0 >>>> * Chrome Version 41.0.2272.118 (64-bit) on Ubuntu >>>> >>>> >>>> On Tue, Oct 13, 2015 at 3:27 PM, Jean-Baptiste Onofré <j...@nanthrax.net >>>> <mailto:j...@nanthrax.net>> wrote: >>>> >>>> Hi Joshua, >>>> >>>> What's the Spark version and what's your browser ? >>>> >>>> I just tried on Spark 1.6-SNAPSHOT with firefox and it works fine. >>>> >>>> Thanks >>>> Regards >>>> JB >>>> >>>> On 10/13/2015 02:17 PM, Joshua Fox wrote: >>>> >>>> I am accessing the Spark Jobs Web GUI, running on AWS EMR. >>>> >>>> I can access this webapp (port 4040 as per default), but it only >>>> half-renders, producing "Uncaught SyntaxError: Unexpected token >>>> <" >>>> >>>> Here is a screenshot <http://i.imgur.com/qP2rH46.png> including >>>> Chrome >>>> Developer Console. >>>> >>>> Screenshot <http://i.stack.imgur.com/cf8gp.png> >>>> >>>> Here are some of the error messages in my Chrome console. >>>> >>>> /Uncaught SyntaxError: Unexpected token < >>>> (index):3 Resource interpreted as Script but transferred with >>>> MIME type >>>> text/html: >>>> " >>>> http://ec2-52-89-59-167.us-west-2.compute.amazonaws.com:4040/jobs/";. >>>> (index):74 Uncaught ReferenceError: drawApplicationTimeline is >>>> not defined >>>> (index):12 Resource interpreted as Image but transferred with >>>> MIME type >>>> text/html: >>>> " >>>> http://ec2-52-89-59-167.us-west-2.compute.amazonaws.com:4040/jobs/"; >>>> >>>> / >>>> Note that the History GUI at port 18080 and the Hadoop GUI at >>>> port 8088 >>>> work fine, and the Spark jobs GUI does partly render. So, it >>>> seems that >>>> my browser proxy is not the cause of this problem. >>>> >>>> Joshua >>>> >>>> >>>> -- >>>> Jean-Baptiste Onofré >>>> jbono...@apache.org <mailto:jbono...@apache.org> >>>> http://blog.nanthrax.net >>>> Talend - http://www.talend.com >>>> >>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>>> <mailto:user-unsubscr...@spark.apache.org> >>>> For additional commands, e-mail: user-h...@spark.apache.org >>>> <mailto:user-h...@spark.apache.org> >>>> >>>> >>>> >>> -- >>> Jean-Baptiste Onofré >>> jbono...@apache.org >>> http://blog.nanthrax.net >>> Talend - http://www.talend.com >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>> For additional commands, e-mail: user-h...@spark.apache.org >>> >>> >> >
