Hi Sachit, Can you give more details on how did you run? i.e. spark submit command. My guess is, a service account with sufficient privilege is not provided. Please see: http://spark.apache.org/docs/latest/running-on-kubernetes.html#rbac
Thanks, On Mon, Jan 4, 2021 at 5:27 PM Sachit Murarka <connectsac...@gmail.com> wrote: > Hi All, > I am getting the below error when I am trying to run the spark job on > Kubernetes, I am running it in cluster mode. > > Exception in thread "main" > io.fabric8.kubernetes.client.KubernetesClientException: Operation: > [create] for kind: [Pod] with name: [null] in namespace: > [spark-test] failed. > at > io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:64) > at > io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:72) > > > I saw there was an JIRA opened already. SPARK-31786 > I tried the parameter mentioned in JIRA > too(spark.kubernetes.driverEnv.HTTP2_DISABLE=true), that also did not work. > Can anyone suggest what can be done? > > Kind Regards, > Sachit Murarka >
