Hi Karan,
In the executor I see you have volume (and not just volumeMounts)- I don't
see you have volume in the driver - so you probably don't have such a
volume.
Also - please check if the volume has in its data section
for spark-gcs-key.json - you can check it with:
describe secret
HTH,
Nimrod
Hi Nimrod,
Thanks for the response ..
The volume gcs-key(representing secret - spark-gcs-creds) is shared between
the driver & executor both of which have the volumeMounts (screenshot
attached).
[image: Screenshot 2024-10-06 at 11.35.19 AM.png]
'volumes' is defined at the same level as driver & e
