Unable to kill spark app gracefully. Unable to stop driver in cluster mode

[Ravi Agrawal]

Hi, While working on Spark 1.6.1, I ran into an issue with closing the Spark app. I tried it with deploy-mode as client as well as cluster: Firstly, deploy-mode : client Ran the app using below command: /usr/local/spark/spark-1.6.1-bin-hadoop2.6/bin/spark-submit --supervise --class <Qualified class name> <Jar path> Killed from UI by clicking the 'kill' link: App got removed from UI but it was still running on the server. Killed using below command: bin/spark-class org.apache.spark.deploy.Client kill spark://raviagrawal:7077 app-20160617181402-0005 The above command did not work. Gave below message on console: ClientEndpoint: Driver app-20160617181402-0005 has already finished or does not exist The app was still running Secondly, deploy-mode : cluster Ran the app using below command: /usr/local/spark/spark-1.6.1-bin-hadoop2.6/bin/spark-submit  --master spark://raviagrawal:7077 --deploy-mode cluster --supervise --class <Qualified class name> <Jar path> Killed from UI by clicking the 'kill' link: App got removed from UI but it was still running on the server. Unable to kill driver from UI Killed using below command: bin/spark-class org.apache.spark.deploy.Client kill spark://raviagrawal:7077 driver-20160617181915-0003 The above command did not work. Gave below message on console: 16/06/17 18:20:04 INFO ClientEndpoint: Kill request for driver-20160617181915-0003 submitted 16/06/17 18:20:04 INFO ClientEndpoint: ... waiting before polling master for driver state 16/06/17 18:20:09 INFO ClientEndpoint: ... polling master for driver state 16/06/17 18:20:09 INFO ClientEndpoint: State of driver-20160617181915-0003 is RUNNING 16/06/17 18:20:09 INFO ClientEndpoint: Driver running on 172.19.19.105:55454 (worker-20160617134955-172.19.19.105-55454) I went through the resources available online but could not find a solution to the problem. I can kill the process using kill -9 pid, but do not want to use it. I want to kill the app gracefully. Also found this JIRA mentioning almost the same issue, but the status of that has been changed to Invalid as several questions were asked in it. Can you please help me on this? Thanks, -Ravi. Talentica Software India Pvt. Ltd. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org