Re: Spark job is running infinitely

2015-10-12 Thread Ted Yu
t; On Mon, Oct 12, 2015 at 10:46 PM, Ted Yu wrote: >>> >>>> Do you have monitoring put in place to detect 'no space left' scenario >>>> ? >>>> >>>> By 'way to kill job', do you mean automatic kill ? >>>> >>

Re: Spark job is running infinitely

2015-10-12 Thread Saurav Sinha
gt; >>>> Do you have monitoring put in place to detect 'no space left' scenario >>>> ? >>>> >>>> By 'way to kill job', do you mean automatic kill ? >>>> >>>> Please include the release of Spark, command line for 'sp

Re: Spark job is running infinitely

2015-10-12 Thread Saurav Sinha
d Yu wrote: >> >>> Do you have monitoring put in place to detect 'no space left' scenario ? >>> >>> By 'way to kill job', do you mean automatic kill ? >>> >>> Please include the release of Spark, command line for 'spark-submit' in &

Re: Spark job is running infinitely

2015-10-12 Thread Ted Yu
Spark, command line for 'spark-submit' in >> your reply. >> >> Thanks >> >> On Mon, Oct 12, 2015 at 10:07 AM, Saurav Sinha >> wrote: >> >>> Hi Experts, >>> >>> I am facing issue in which spark job is running infinitely. >&

Re: Spark job is running infinitely

2015-10-12 Thread Saurav Sinha
#x27; in > your reply. > > Thanks > > On Mon, Oct 12, 2015 at 10:07 AM, Saurav Sinha > wrote: > >> Hi Experts, >> >> I am facing issue in which spark job is running infinitely. >> >> When I start spark job on 4 node cluster. >> >> In w

Re: Spark job is running infinitely

2015-10-12 Thread Ted Yu
wrote: > Hi Experts, > > I am facing issue in which spark job is running infinitely. > > When I start spark job on 4 node cluster. > > In which there is no space left on one machine then it is running infinity. > > Does any one can across such an issue. Is any why to ki

Spark job is running infinitely

2015-10-12 Thread Saurav Sinha
Hi Experts, I am facing issue in which spark job is running infinitely. When I start spark job on 4 node cluster. In which there is no space left on one machine then it is running infinity. Does any one can across such an issue. Is any why to kill job when such thing happens. -- Thanks and