That's to be expected - the application UI is not started by the master, but by
the driver. So the UI will run on the machine that submits the job.
> On 26.07.2016, at 15:49, Jestin Ma wrote:
>
> I did netstat -apn | grep 4040 on machine 6, and I see
>
> tcp0 0 :::4040
public DNS name
* the private ip in our example is 172.31.23.201
From: Jacek Laskowski
Date: Tuesday, July 26, 2016 at 6:38 AM
To: Jestin Ma
Cc: Chanh Le , "user @spark"
Subject: Re: Spark Web UI port 4040 not working
> Hi,
>
> Do you perhaps deploy using cluster mode?
Also, sorry for the repeated updates, I checked my master UI and it says no
drivers are running but 1 application is running.
On Tue, Jul 26, 2016 at 6:49 AM, Jestin Ma
wrote:
> I did netstat -apn | grep 4040 on machine 6, and I see
>
> tcp0 0 :::4040 :::*
> LIS
I did netstat -apn | grep 4040 on machine 6, and I see
tcp0 0 :::4040 :::*
LISTEN 30597/java
What does this mean?
On Tue, Jul 26, 2016 at 6:47 AM, Jestin Ma
wrote:
> I do not deploy using cluster mode and I don't use EC2.
>
> I just read that launching as
I do not deploy using cluster mode and I don't use EC2.
I just read that launching as client mode: "the driver is launched directly
within the spark-submit process which acts as a *client* to the cluster."
My current setup is that I have cluster machines 1, 2, 3, 4, 5, with 1
being the master.
I
I tried doing that on my master node.
I got nothing.
However, I grep'd port 8080 and I got the standalone UI.
On Tue, Jul 26, 2016 at 12:39 AM, Chanh Le wrote:
> You’re running in StandAlone Mode?
> Usually inside active task it will show the address of current job.
> or you can check in master
Hi,
Do you perhaps deploy using cluster mode? Is this EC2? You'd need to
figure out where the driver runs and use the machine's IP.
Pozdrawiam,
Jacek Laskowski
https://medium.com/@jaceklaskowski/
Mastering Apache Spark http://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jac
Hi,
Go to 8080 and under Running Applications click the Application ID.
You're on the page with Application Detail UI just before Executor
Summary table. Use it to access the web UI.
Pozdrawiam,
Jacek Laskowski
https://medium.com/@jaceklaskowski/
Mastering Apache Spark http://bit.ly/masterin
You’re running in StandAlone Mode?
Usually inside active task it will show the address of current job.
or you can check in master node by using netstat -apn | grep 4040
> On Jul 26, 2016, at 8:21 AM, Jestin Ma wrote:
>
> Hello, when running spark jobs, I can access the master UI (port 8080 one
