Re: Docker/Mesos with Spark

2016-01-19 Thread Nagaraj Chandrashekar
mailto:dar...@ontrenet.com>> Date: Wednesday, January 20, 2016 at 8:15 AM To: Sathish Kumaran Vairavelu mailto:vsathishkuma...@gmail.com>>, Tim Chen mailto:t...@mesosphere.io>> Cc: John Omernik mailto:j...@omernik.com>>, user mailto:user@spark.apache.org>> Subject: Re: D

Re: Docker/Mesos with Spark

2016-01-19 Thread Darren Govoni
: Tim Chen Cc: John Omernik , user Subject: Re: Docker/Mesos with Spark Thank you! Looking forward for it.. On Tue, Jan 19, 2016 at 4:03 PM Tim Chen wrote: Hi Sathish, Sorry about that, I think that's a good idea and I'll write up a section in the Spark documentation page to expl

Re: Docker/Mesos with Spark

2016-01-19 Thread Sathish Kumaran Vairavelu
Thank you! Looking forward for it.. On Tue, Jan 19, 2016 at 4:03 PM Tim Chen wrote: > Hi Sathish, > > Sorry about that, I think that's a good idea and I'll write up a section > in the Spark documentation page to explain how it can work. We (Mesosphere) > have been doing this for our DCOS spark

Re: Docker/Mesos with Spark

2016-01-19 Thread Tim Chen
Hi Sathish, Sorry about that, I think that's a good idea and I'll write up a section in the Spark documentation page to explain how it can work. We (Mesosphere) have been doing this for our DCOS spark for our past releases and has been working well so far. Thanks! Tim On Tue, Jan 19, 2016 at 12

Re: Docker/Mesos with Spark

2016-01-19 Thread Sathish Kumaran Vairavelu
Hi Tim Do you have any materials/blog for running Spark in a container in Mesos cluster environment? I have googled it but couldn't find info on it. Spark documentation says it is possible, but no details provided.. Please help Thanks Sathish On Mon, Sep 21, 2015 at 11:54 AM Tim Chen wrote:

Re: Docker/Mesos with Spark

2015-09-21 Thread Tim Chen
Hi John, There is no other blog post yet, I'm thinking to do a series of posts but so far haven't get time to do that yet. Running Spark in docker containers makes distributing spark versions easy, it's simple to upgrade and automatically caches on the slaves so the same image just runs right awa

Docker/Mesos with Spark

2015-09-19 Thread John Omernik
I was searching in the 1.5.0 docs on the Docker on Mesos capabilities and just found you CAN run it this way. Are there any user posts, blog posts, etc on why and how you'd do this? Basically, at first I was questioning why you'd run spark in a docker container, i.e., if you run with tar balled e