[Spark Core]: Unexpectedly exiting executor while gracefully decommissioning

2022-04-25 Thread Saurabh Gulati
Hey guys, My colleague tried to post a question twice but somehow it doesn't show up in or emails, but it does exist in the archive. So, I will post the question here again. We are running into some issues while attempting grace

[Spark Core]: Unexpectedly exiting executor while gracefully decommissioning

2022-04-22 Thread Yeachan Park
Hello all, we are running into some issues while attempting graceful decommissioning of executors. We are running spark-thriftserver (3.2.0) on Kubernetes (GKE 1.20.15-gke.2500). We enabled: - spark.decommission.enabled - spark.storage.decommission.rddBlocks.enabled - spark.storage.decomm

[Spark Core]: Unexpectedly exiting executor while gracefully decommissioning

2022-04-21 Thread Yeachan Park
Hello all, we are running into some issues while attempting graceful decommissioning of executors. We are running spark-thriftserver (3.2.0) on Kubernetes (GKE 1.20.15-gke.2500). We enabled: - spark.decommission.enabled - spark.storage.decommission.rddBlocks.enabled - spark.storage.decomm