Re: Spark executor pods not getting killed after task completion

2019-10-25 Thread manishgupta88
Issue got resolved after closing the sparkcontext. https://stackoverflow.com/questions/57964848/spark-job-in-kubernetes-stuck-in-running-state -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ - To unsubscribe

Spark executor pods not getting killed after task completion

2019-10-23 Thread manish gupta
Hi I am trying to run spark submit on kubernetes. I am able to achieve the desired results in a way that driver and executors are getting launched as per the given configuration and my job is able to run successfully. *But even after job completion spark driver pod is always in Running state and