Please check what is the spark master url. Set that url while launching spark-shell
You can get it from the terminal where spark master is running or from cluster ui. http://<ip/host of the box where master is running>:8080 Thanks, Sourav On Mon, Jun 23, 2014 at 10:56 AM, rapelly kartheek <kartheek.m...@gmail.com> wrote: > Hi > Can someone help me with the following error that I faced while setting > up single node spark framework. > > karthik@karthik-OptiPlex-9020:~/spark-1.0.0$ > MASTER=spark://localhost:7077 sbin/spark-shell > bash: sbin/spark-shell: No such file or directory > karthik@karthik-OptiPlex-9020:~/spark-1.0.0$ > MASTER=spark://localhost:7077 bin/spark-shell > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=128m; support was removed in 8.0 > 14/06/23 10:44:53 INFO spark.SecurityManager: Changing view acls to: > karthik > 14/06/23 10:44:53 INFO spark.SecurityManager: SecurityManager: > authentication disabled; ui acls disabled; users with view permissions: > Set(karthik) > 14/06/23 10:44:53 INFO spark.HttpServer: Starting HTTP Server > 14/06/23 10:44:53 INFO server.Server: jetty-8.y.z-SNAPSHOT > 14/06/23 10:44:53 INFO server.AbstractConnector: Started > SocketConnector@0.0.0.0:39588 > Welcome to > ____ __ > / __/__ ___ _____/ /__ > _\ \/ _ \/ _ `/ __/ '_/ > /___/ .__/\_,_/_/ /_/\_\ version 1.0.0 > /_/ > > Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java > 1.8.0_05) > Type in expressions to have them evaluated. > Type :help for more information. > 14/06/23 10:44:55 INFO spark.SecurityManager: Changing view acls to: > karthik > 14/06/23 10:44:55 INFO spark.SecurityManager: SecurityManager: > authentication disabled; ui acls disabled; users with view permissions: > Set(karthik) > 14/06/23 10:44:55 INFO slf4j.Slf4jLogger: Slf4jLogger started > 14/06/23 10:44:55 INFO Remoting: Starting remoting > 14/06/23 10:44:55 INFO Remoting: Remoting started; listening on addresses > :[akka.tcp://spark@karthik-OptiPlex-9020:50294] > 14/06/23 10:44:55 INFO Remoting: Remoting now listens on addresses: > [akka.tcp://spark@karthik-OptiPlex-9020:50294] > 14/06/23 10:44:55 INFO spark.SparkEnv: Registering MapOutputTracker > 14/06/23 10:44:55 INFO spark.SparkEnv: Registering BlockManagerMaster > 14/06/23 10:44:55 INFO storage.DiskBlockManager: Created local directory > at /tmp/spark-local-20140623104455-3297 > 14/06/23 10:44:55 INFO storage.MemoryStore: MemoryStore started with > capacity 294.6 MB. > 14/06/23 10:44:55 INFO network.ConnectionManager: Bound socket to port > 60264 with id = ConnectionManagerId(karthik-OptiPlex-9020,60264) > 14/06/23 10:44:55 INFO storage.BlockManagerMaster: Trying to register > BlockManager > 14/06/23 10:44:55 INFO storage.BlockManagerInfo: Registering block manager > karthik-OptiPlex-9020:60264 with 294.6 MB RAM > 14/06/23 10:44:55 INFO storage.BlockManagerMaster: Registered BlockManager > 14/06/23 10:44:55 INFO spark.HttpServer: Starting HTTP Server > 14/06/23 10:44:55 INFO server.Server: jetty-8.y.z-SNAPSHOT > 14/06/23 10:44:55 INFO server.AbstractConnector: Started > SocketConnector@0.0.0.0:38307 > 14/06/23 10:44:55 INFO broadcast.HttpBroadcast: Broadcast server started > at http://10.0.1.61:38307 > 14/06/23 10:44:55 INFO spark.HttpFileServer: HTTP File server directory is > /tmp/spark-082a44f6-e877-48cc-8ab7-1bcbcf8136b0 > 14/06/23 10:44:55 INFO spark.HttpServer: Starting HTTP Server > 14/06/23 10:44:55 INFO server.Server: jetty-8.y.z-SNAPSHOT > 14/06/23 10:44:55 INFO server.AbstractConnector: Started > SocketConnector@0.0.0.0:58745 > 14/06/23 10:44:56 INFO server.Server: jetty-8.y.z-SNAPSHOT > 14/06/23 10:44:56 INFO server.AbstractConnector: Started > SelectChannelConnector@0.0.0.0:4040 > 14/06/23 10:44:56 INFO ui.SparkUI: Started SparkUI at > http://karthik-OptiPlex-9020:4040 > 14/06/23 10:44:56 WARN util.NativeCodeLoader: Unable to load native-hadoop > library for your platform... using builtin-java classes where applicable > 14/06/23 10:44:56 INFO client.AppClient$ClientActor: Connecting to master > spark://localhost:7077... > 14/06/23 10:44:56 INFO repl.SparkILoop: Created spark context.. > 14/06/23 10:44:56 WARN client.AppClient$ClientActor: Could not connect to > akka.tcp://sparkMaster@localhost:7077: > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkMaster@localhost:7077] > Spark context available as sc. > > scala> 14/06/23 10:44:56 WARN client.AppClient$ClientActor: Could not > connect to akka.tcp://sparkMaster@localhost:7077: > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkMaster@localhost:7077] > 14/06/23 10:44:56 WARN client.AppClient$ClientActor: Could not connect to > akka.tcp://sparkMaster@localhost:7077: > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkMaster@localhost:7077] > 14/06/23 10:44:56 WARN client.AppClient$ClientActor: Could not connect to > akka.tcp://sparkMaster@localhost:7077: > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkMaster@localhost:7077] > 14/06/23 10:45:16 INFO client.AppClient$ClientActor: Connecting to master > spark://localhost:7077... > 14/06/23 10:45:16 WARN client.AppClient$ClientActor: Could not connect to > akka.tcp://sparkMaster@localhost:7077: > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkMaster@localhost:7077] > 14/06/23 10:45:16 WARN client.AppClient$ClientActor: Could not connect to > akka.tcp://sparkMaster@localhost:7077: > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkMaster@localhost:7077] > 14/06/23 10:45:16 WARN client.AppClient$ClientActor: Could not connect to > akka.tcp://sparkMaster@localhost:7077: > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkMaster@localhost:7077] > 14/06/23 10:45:16 WARN client.AppClient$ClientActor: Could not connect to > akka.tcp://sparkMaster@localhost:7077: > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkMaster@localhost:7077] > 14/06/23 10:45:36 INFO client.AppClient$ClientActor: Connecting to master > spark://localhost:7077... > 14/06/23 10:45:36 WARN client.AppClient$ClientActor: Could not connect to > akka.tcp://sparkMaster@localhost:7077: > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkMaster@localhost:7077] > 14/06/23 10:45:36 WARN client.AppClient$ClientActor: Could not connect to > akka.tcp://sparkMaster@localhost:7077: > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkMaster@localhost:7077] > 14/06/23 10:45:36 WARN client.AppClient$ClientActor: Could not connect to > akka.tcp://sparkMaster@localhost:7077: > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkMaster@localhost:7077] > 14/06/23 10:45:36 WARN client.AppClient$ClientActor: Could not connect to > akka.tcp://sparkMaster@localhost:7077: > akka.remote.EndpointAssociationException: Association failed with > [akka.tcp://sparkMaster@localhost:7077] > > > > Thanks in advance!!! > -- Sourav Chandra Senior Software Engineer · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · sourav.chan...@livestream.com o: +91 80 4121 8723 m: +91 988 699 3746 skype: sourav.chandra Livestream "Ajmera Summit", First Floor, #3/D, 68 Ward, 3rd Cross, 7th C Main, 3rd Block, Koramangala Industrial Area, Bangalore 560034 www.livestream.com
