Hi Luca
Are you able to run these commands from scala REPL shell ? Atleast 1 round
of iteration?
Looking at the error which says remote end shutting down - i suspect some
command in the code is triggering sc context shutdown or something similar.
One more point - if both master and executer both
I don't think it's a "malformed IP address" issue because I have used an uri
and not an IP.
Another info, the master, driver and workers are hosted on the same machine
so I use "localhost" as host for the Driver.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.c
This is the master's log file:
15/12/22 03:23:05 ERROR FileAppender: Error writing stream to file
/disco1/spark-1.5.1/work/app-20151222032252-0010/0/stderr
java.io.IOException: Stream closed
at
java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:162)
at java.io.Buffe
I was going off this, not sure if it gives you a clue:
http://doc.akka.io/api/akka/2.4.0/index.html#akka.remote.transport.Transport$$InvalidAssociationException
"Indicates that the association setup request is invalid, and it is
impossible to recover (malformed IP address, hostname, etc.)."
I do
Gotcha, then you are also replacing the cluster IP. Missed that.
I would ask you to post the actual logfiles, not sure I'll be able to help
but hopefully it gives more info that someone can work with :)
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Proble
Hi MegaLearn!
thanks for the reply!
it's a placeholder, in my real application I use the right
master's hostname.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Problem-with-Spark-Standalone-tp25750p25752.html
Sent from the Apache Spark User List mailing
Perhaps put the master IP address in this line and try again?
setMaster("spark://:7077").
Replace with hostname, but the way our host files are setup I
have to put the IP address there.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Problem-with-Spark-S
