Re: Method for gracefully terminating a driver on a standalone master in Spark 2.1+

As I cannot find a way to gracefully kill an app which takes longer than 10 seconds to shut down, I have reported this issue as a bug: https://issues.apache.org/jira/browse/SPARK-20843 Michael > On May 4, 2017, at 4:15 PM, Michael Allman wro

Method for gracefully terminating a driver on a standalone master in Spark 2.1+

Hello, In performing our prod cluster upgrade, we've noticed that the behavior for killing a driver is more aggressive. Whereas pre-2.1 the driver runner would only call `Process.destroy`, in 2.1+ it now calls `Process.destroyForcibly` (on Java 8) if the previous `destroy` call does not return