Re: spark main thread quit, but the driver don't crash at standalone cluster

2017-01-19 Thread Liang-Chi Hsieh
Can you just cancel the `ScheduledFuture` returned by `scheduleAtFixedRate` when catching the exception in the main thread of the spark driver? John Fang wrote > My spark main thread create some daemon threads which maybe timer thread. > Then the spark application throw some exceptions, and the

spark main thread quit, but the driver don't crash at standalone cluster

2017-01-17 Thread John Fang
My spark main thread create some daemon threads which maybe timer thread. Then the spark application throw some exceptions, and the main thread will quit. But the jvm of driver don't crash for standalone cluster. Of course the question don't happen at yarn cluster. Because the application master