Was having some issues with this too. Did you try using the %sh to ping the machine with spark? e.g. check for networking issue.
Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo http://trevorgrant.org *"Fortunate is he, who is able to know the causes of things." -Virgil* On Fri, Aug 5, 2016 at 3:29 PM, Luciano Resende <luckbr1...@gmail.com> wrote: > > > On Fri, Aug 5, 2016 at 11:18 PM, Luciano Resende <luckbr1...@gmail.com> > wrote: > >> Not exactly what you want, but I have an example here : >> https://github.com/lresende/docker-systemml-notebook >> >> You should be able to accomplish what you want playing with --link which >> I did in the example below (but just with Yarn and HDFS) >> https://github.com/lresende/docker-yarn-cluster >> >> > BTW, you might have to use Levy to access the remote Spark. > > -- > Luciano Resende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ >