Question on spark on Kubernetes

[Mithalee Mohapatra]

Hi,
I am currently trying to run spark submit in Kubernetes. I have set up the
IAM roles for serviceaccount and generated the ARN. I am trying to use the
"spark.hadoop.fs.s3a.fast.upload=true --conf
spark.hadoop.fs.s3a.aws.credentials.provider=com.amazonaws.auth.WebIdentityTokenCredentialsProvider"
but getting the below error. Do I need to create a token file. What will be
the content of the token file and how can I deploy it in the cluster.
[image: image.png]