Re: spark k8s submit

2025-01-03 Thread jilani shaik
gt; https://github.com/apache/spark/tree/master/resource-managers/kubernetes/integration-tests/src/test/resources > > 1. driver-schedule-template.yml > 2. driver-template.yml > 3. executor-template.yml > > Dongjoon. > > On Thu, Jan 2, 2025 at 12:07 PM jilani shaik wrote: >

spark k8s submit

2025-01-02 Thread jilani shaik
Hi, I am trying to run Spark on the Kubernetes cluster, but that cluster has certain validation to deploy any pod that is not allowing me to run my Spark submit. for example, I need to add liveness, readiness probes and certain security capability restrictions, which we usually do for all outer p