Re: Spark 1.0.0 fails if mesos.coarse set to true

2014-06-04 Thread Patrick Wendell
Hey, thanks a lot for reporting this. Do you mind making a JIRA with the details so we can track it? - Patrick On Wed, Jun 4, 2014 at 9:24 AM, Marek Wiewiorka wrote: > Exactly the same story - it used to work with 0.9.1 and does not work > anymore with 1.0.0. > I ran tests using spark-shell as w

Re: Spark 1.0.0 fails if mesos.coarse set to true

2014-06-04 Thread Marek Wiewiorka
Exactly the same story - it used to work with 0.9.1 and does not work anymore with 1.0.0. I ran tests using spark-shell as well as my application(so tested turning on coarse mode via env variable and SparkContext properties explicitly) M. 2014-06-04 18:12 GMT+02:00 ajatix : > I'm running a man

Re: Spark 1.0.0 fails if mesos.coarse set to true

2014-06-04 Thread ajatix
I'm running a manually built cluster on EC2. I have mesos (0.18.2) and hdfs (2.0.0-cdh4.5.0) installed on all slaves (3) and masters (3). I have spark-1.0.0 on one master and the executor file is on hdfs for the slaves. Whenever I try to launch a spark application on the cluster, it starts a task

Re: Spark 1.0.0 fails if mesos.coarse set to true

2014-06-04 Thread Mark Hamstra
Are you using spark-submit to run your application? On Wed, Jun 4, 2014 at 8:49 AM, ajatix wrote: > I am also getting the exact error, with the exact logs when I run Spark > 1.0.0 > in coarse-grained mode. > Coarse grained mode works perfectly with earlier versions that I tested - > 0.9.1 and 0

Re: Spark 1.0.0 fails if mesos.coarse set to true

2014-06-04 Thread ajatix
I am also getting the exact error, with the exact logs when I run Spark 1.0.0 in coarse-grained mode. Coarse grained mode works perfectly with earlier versions that I tested - 0.9.1 and 0.9.0, but seems to have undergone some modification in spark 1.0.0 -- View this message in context: http://

Spark 1.0.0 fails if mesos.coarse set to true

2014-06-03 Thread Marek Wiewiorka
Hi All, I'm trying to run my code that used to work with mesos-0.14 and spark-0.9.0 with mesos-0.18.2 and spark-1.0.0. and I'm getting a weird error when I use coarse mode (see below). If I use the fine-grained mode everything is ok. Has anybody of you experienced a similar error? more stderr