OK, the thing is that the JVMs are not shut down when you cancel the task. Therefore no shut down hook is executed when you cancel.
You would have to execute bin/stop-cluster.sh to stop the JVM. Does that make sense? On Wed, Mar 8, 2017 at 3:34 PM, Dominik Safaric <[email protected]> wrote: > I’m not using YARN but instead of starting the cluster using > bin/start-cluster.sh > >> On 8 Mar 2017, at 15:32, Ufuk Celebi <[email protected]> wrote: >> >> On Wed, Mar 8, 2017 at 3:19 PM, Dominik Safaric >> <[email protected]> wrote: >>> The cluster consists of 4 workers and a master node. >> >> Are you starting the cluster via bin/start-cluster.sh or are you using >> YARN etc.? >
