Re: Mesos killing Spark Driver

2014-11-28 Thread Gerard Maas
[Ping] Any hints? On Thu, Nov 27, 2014 at 3:38 PM, Gerard Maas wrote: > Hi, > > We are currently running our Spark + Spark Streaming jobs on Mesos, > submitting our jobs through Marathon. > We see with some regularity that the Spark Streaming driver gets killed by > Mesos and then restarted on s

Mesos killing Spark Driver

2014-11-27 Thread Gerard Maas
Hi, We are currently running our Spark + Spark Streaming jobs on Mesos, submitting our jobs through Marathon. We see with some regularity that the Spark Streaming driver gets killed by Mesos and then restarted on some other node by Marathon. I've no clue why Mesos is killing the driver and lookin