Re: Got fatal error when running spark 2.4.0 on k8s

2019-02-13 Thread dawn breaks
It seems that fabric8 kubernetes client can't parse the caCertFile in the default location /var/run/secrets/kubernetes.io/serviceaccount/ca.crt, and anybody give me some advices? On Wed, 13 Feb 2019 at 16:21, dawn breaks <2005dawnbre...@gmail.com> wrote: > we submit spark job to k8s by the follo

RE: Got fatal error when running spark 2.4.0 on k8s

2019-02-13 Thread Sinha, Breeta (Nokia - IN/Bangalore)
was able to see “Pi is roughly 3.139774279548559” in the pod’s output log. Hope this will help! 😊 Regards, Breeta From: dawn breaks <2005dawnbre...@gmail.com> Sent: Wednesday, February 13, 2019 1:52 PM To: user@spark.apache.org Subject: Got fatal error when running spark 2.4.0 on k8s we

Got fatal error when running spark 2.4.0 on k8s

2019-02-13 Thread dawn breaks
we submit spark job to k8s by the following command, and the driver pod got an error and exit. Anybody can help us to solve it? ./bin/spark-submit \ --master k8s://https://172.21.91.48:6443 \ --deploy-mode cluster \ --conf spark.kubernetes.authenticate.driver.serviceAccountName=spark