Spark on Mesos 0.20

2014-10-05 Thread Fairiz Azizi
The Spark online docs indicate that Spark is compatible with Mesos 0.18.1 I've gotten it to work just fine on 0.18.1 and 0.18.2 Has anyone tried Spark on a newer version of Mesos, i.e. Mesos v0.20.0? -Fi

Re: Spark on Mesos 0.20

2014-10-06 Thread Fairiz Azizi
gt; > (Hit enter too soon...) > >> > > >> > What is your setup and steps to repro this? > >> > > >> > Tim > >> > > >> > On Mon, Oct 6, 2014 at 12:30 AM, Timothy Chen > wrote: > >> >> Hi Gurvinder, > >>

Re: Spark on Mesos 0.20

2014-10-07 Thread Fairiz Azizi
1.1.0 and mesos 0.20.1. > > Fairiz, could you try running the logquery example included with Spark and > see what you get? > > Thanks! > > On Mon, Oct 6, 2014 at 8:07 PM, Fairiz Azizi wrote: > >> That's what great about Spark, the community is so active! :) >

Re: Spark on Mesos 0.20

2014-10-09 Thread Fairiz Azizi
;s the example I was talking about. > > Is an error message printed when it hangs? I get : > > 14/09/30 13:23:14 ERROR BlockManagerMasterActor: Got two different block > manager registrations on 20140930-131734-1723727882-5050-1895-1 > > > > On Tue, Oct 7, 2014 at 8:36 PM

Re: Spark on Mesos 0.20

2014-10-17 Thread Fairiz Azizi
u might try is increasing your spark.executor.memory setting Mine was set to 8GB in the spark-defaults.conf file. Hope this helps, Fi Fairiz "Fi" Azizi On Thu, Oct 9, 2014 at 11:35 PM, Gurvinder Singh wrote: > On 10/10/2014 06:11 AM, Fairiz Azizi wrote: > > Hello, > >