Yeah, sounds a lot like the client cannot connect to the JobManager port.
The ports to communicate with HDFS and the YARN resource manager may be
whitelisted r forwarded, so you can submit the YARN session, but then not
connect to the JobManager afterwards.
On Sat, Feb 6, 2016 at 2:11 PM, Piete
Hi Max!
I'm using Flink 0.10.1 and indeed the cluster seems to be created fine, all
in the JobManager Web UI looks good.
It seems like the JobManager initiates the connection with my VM and cannot
reach it. It could be that this is similar to the problem here:
http://apache-spark-user-list.10015
Hi Pieter,
Which version of Flink are you using? It appears you've created a
Flink YARN cluster but you can't reach the JobManager afterwards.
Cheers,
Max
On Sat, Feb 6, 2016 at 1:42 PM, Pieter Hameete wrote:
> Hi Robert,
>
> unfortunately there are no signs of what is going wrong in the logs.
Hi Robert,
unfortunately there are no signs of what is going wrong in the logs. The
last log messages are about succesful registration of the TaskManagers.
I'm also fairly sure it must be something in my VM that is causing this,
because when I start the yarn-session from a login node that is on t
You can count the number of elements per key. This allows you to see how
they are distributed.
On Sat, Feb 6, 2016 at 1:23 PM, Flavio Pompermaier
wrote:
> And what if I detect some skewness in some task? Do I have to try to call
> rebalance()?is there a way to identify the keys causing the skewn
And what if I detect some skewness in some task? Do I have to try to call
rebalance()?is there a way to identify the keys causing the skewness?
On 5 Feb 2016 21:33, "Ufuk Celebi" wrote:
>
> > On 05 Feb 2016, at 16:38, Flavio Pompermaier
> wrote:
> >
> > Is there an easy way to understand if and
Hi,
did you check the logs of the JobManager itself? Maybe it'll tell us
already whats going on.
On Sat, Feb 6, 2016 at 12:14 PM, Pieter Hameete wrote:
> Hi Guys!
>
> Im attempting to run Flink on YARN, but I run into an issue. Im starting
> the Flink YARN session from an Ubuntu 14.04 VM. All g
Hi Guys!
Im attempting to run Flink on YARN, but I run into an issue. Im starting
the Flink YARN session from an Ubuntu 14.04 VM. All goes well until after
the JobManager web UI is started:
JobManager web interface address
http://head05.hathi.surfsara.nl:8088/proxy/application_1452780322684_10532
