Re: Mesos resource allocation

2015-01-05 Thread Tim Chen
e spark executors are started by Mesos executors > that is configured from Mesos scheduler backend. I believe the RDD is > cached as long as the Mesos executor is running as the BlockManager is > created on executor registration. > > > > Let me know if you need any more info. &

Re: Mesos resource allocation

2015-01-05 Thread Josh Devins
ted on > executor registration. > > Let me know if you need any more info. > > Tim > > >> >> ------ Forwarded message -- >> From: Josh Devins >> Date: 22 December 2014 at 17:23 >> Subject: Mesos resource allocation >> To: user@

Fwd: Mesos resource allocation

2014-12-23 Thread Tim Chen
--- > From: Josh Devins > Date: 22 December 2014 at 17:23 > Subject: Mesos resource allocation > To: user@spark.apache.org > > > We are experimenting with running Spark on Mesos after running > successfully in Standalone mode for a few months. With the Standalone > resou

Mesos resource allocation

2014-12-22 Thread Josh Devins
We are experimenting with running Spark on Mesos after running successfully in Standalone mode for a few months. With the Standalone resource manager (as well as YARN), you have the option to define the number of cores, number of executors and memory per executor. In Mesos, however, it appears as t