Re: Run spark on mesos remotely

Dear all, After studying the source code and my environment, I guess the problem is that the hostPort is wrong. On my machine, the hostname will be exported into `blockManager.hostPort` such as wush-home:45678, but the slaves could not resolve the hostname to ip correctly. I am trying to solve the

Re: Run spark on mesos remotely

Dear Rustagi, Thanks for you response. As far as I know, the DAG scheduler should be a part of spark. Therefore, should I do something not mentioned in http://spark.incubator.apache.org/docs/0.8.1/running-on-mesos.html to launch the DAG scheduler? By the way, I also notice that the user of the s

Re: Run spark on mesos remotely

Yes but you have to maintain connection of that machine to the master cluster as the driver with DAG scheduler runs on that machine. Regards Mayur Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi On Thu, Mar 27, 2014 at 4:09

Run spark on mesos remotely

Dear all, We have a spark 0.8.1 cluster on mesos 0.15. It works if I submit the job from the master of mesos. That is to say, I spawn the spark shell or launch the scala application on the master of mesos. However, when I submit the job from another machine, the job will lost. The logs shows that