In Kubernetes Must specify the driver container image

2021-12-10 Thread Mich Talebzadeh
Hi, In the following under Spark Kubernetes configuration , it states spark.kubernetes.container.image, default None, meaning:Container image to use for the Spark application. This is usually of the form example.com/

Re: In Kubernetes Must specify the driver container image

2021-12-10 Thread Rob Vesse
Mich I think you may just have a typo in your configuration. These properties all have container in the name, e.g. spark.kubernetes.driver.container.image, BUT you seem to be replacing container with docker in your configuration files so Spark doesn’t recognise the property (i.e. you hav

Re: In Kubernetes Must specify the driver container image

2021-12-10 Thread Mich Talebzadeh
Thanks Rob for spotting the error! view my Linkedin profile *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this em