Re: Mesos Scheduler

Hi Sai, in this simple case Mesos will offer pretty much 50% for each framework. Let's say that R1-R5 will be offered to F1 and R6-R10 will be offered to F2. When resource is offered to a framework it won't be offered to other framework unless the offer is rejected (or the after certain timeout it

Spark executor paths

I'm trying to run Spark on Mesos and I'm getting this error: java.lang.ClassNotFoundException: org/apache/spark/serializer/JavaSerializer at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:270) at org.apache.spark.SparkEnv$.instantiateClass$1(S

Re: java.lang.ClassNotFoundException - spark on mesos

Which repository do you use? The issue should be fixed in 0.9.1 and 1.0.0 https://spark-project.atlassian.net/browse/SPARK-1052 There's an old repository https://github.com/apache/incubator-spark and as Spark become one of top level pr

Re: is Mesos falling out of favor?

I guess it's due to missing documentation and quite complicated setup. Continuous integration would be nice! Btw. is it possible to use spark as a shared library and not to fetch spark tarball for each task? Do you point SPARK_EXECUTOR_URI to HDFS url? -- View this message in context: http:/

Re: is Mesos falling out of favor?

xport CLASSPATH=$CLASSPATH:$SPARK_HOME/lib/ scripts for Debian package are here (I'll try to add some documentation): https://github.com/deric/spark-deb-packaging -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/is-Mesos-falling-out-of-favor-tp5444p5484.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: is Mesos falling out of favor?

I'm also using right now SPARK_EXECUTOR_URI, though I would prefer distributing Spark as a binary package. For running examples with `./bin/run-example ...` it works fine, however tasks from spark-shell are getting lost. Error: Could not find or load main class org.apache.spark.executor.MesosExec