Hi, Setting password less ssh access to your laptop may be a personal risk. I would suppose that you can install Ubuntu over Virtualbox and set the networking option to Bridged so that there are no issues.
For setting passwordless ssh see the following options (source: http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/ ) user@ubuntu:~$ su - hduser hduser@ubuntu:~$ ssh-keygen -t rsa -P "" Generating public/private rsa key pair. Enter file in which to save the key (/home/hduser/.ssh/id_rsa): Created directory '/home/hduser/.ssh'. Your identification has been saved in /home/hduser/.ssh/id_rsa. Your public key has been saved in /home/hduser/.ssh/id_rsa.pub. The key fingerprint is: 9b:82:ea:58:b4:e0:35:d7:ff:19:66:a6:ef:ae:0e:d2 hduser@ubuntu The key's randomart image is: [...snipp...] hduser@ubuntu:~$ After this you will need to use the options here in order to set up a spark cluster http://spark.apache.org/docs/latest/spark-standalone.html so that you have a single master node and several slaves connecting to it. There is only one word of caution though, you will find that you are not using all the clusters in case the file path that you mention exists or is available only in one system. Regards, Gourav Sengupta On Tue, Feb 23, 2016 at 8:39 PM, Robineast <robin.e...@xense.co.uk> wrote: > Hi Thomas > > I can confirm that I have had this working in the past. I'm pretty sure you > don't need password-less SSH for running a standalone cluster manually. Try > running the instructions at > http://spark.apache.org/docs/latest/spark-standalone.html for Starting a > Cluster manually. > > do you get the master running and are you able to log in to the web ui? > Get the spark://<host>:7077 url and start a slave on the same machine as > the > master. Do you see the slave appear in the master web ui? If so can you run > spark-shell by connecting to the master? > > Now start slave on another machine. Do you see the new slave in the master > web ui? > > > > > > ----- > Robin East > Spark GraphX in Action Michael Malak and Robin East > Manning Publications Co. > http://www.manning.com/books/spark-graphx-in-action > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-standalone-peer2peer-network-tp26308p26309.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
