Re: K8S submit client vs. cluster

2021-08-12 Thread Mich Talebzadeh
t; *From:* Mich Talebzadeh > *Sent:* Donnerstag, 12. August 2021 15:47 > *To:* Bode, Meikel, NMA-CFD > *Cc:* user@spark.apache.org > *Subject:* Re: K8S submit client vs. cluster > > > > Ok > > > > As I see it with PySpark even if it is submitted as cluster, it

RE: K8S submit client vs. cluster

2021-08-12 Thread Bode, Meikel, NMA-CFD
On EKS... From: Mich Talebzadeh Sent: Donnerstag, 12. August 2021 15:47 To: Bode, Meikel, NMA-CFD Cc: user@spark.apache.org Subject: Re: K8S submit client vs. cluster Ok As I see it with PySpark even if it is submitted as cluster, it will be converted to client mode anyway Are you running

Re: K8S submit client vs. cluster

2021-08-12 Thread Mich Talebzadeh
2021 at 12:42, Bode, Meikel, NMA-CFD < meikel.b...@bertelsmann.de> wrote: > Hi Mich, > > > > All PySpark. > > > > Best, > > Meikel > > > > *From:* Mich Talebzadeh > *Sent:* Donnerstag, 12. August 2021 13:41 > *To:* Bode, Meikel, NMA-CFD

RE: K8S submit client vs. cluster

2021-08-12 Thread Bode, Meikel, NMA-CFD
Hi Mich, All PySpark. Best, Meikel From: Mich Talebzadeh Sent: Donnerstag, 12. August 2021 13:41 To: Bode, Meikel, NMA-CFD Cc: user@spark.apache.org Subject: Re: K8S submit client vs. cluster Is this Spark or PySpark? [https://docs.google.com/uc?export=download&

Re: K8S submit client vs. cluster

2021-08-12 Thread Mich Talebzadeh
Is this Spark or PySpark? view my Linkedin profile *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's tec

K8S submit client vs. cluster

2021-08-12 Thread Bode, Meikel, NMA-CFD
Hi all, If we schedule a spark job on k8s, how are volume mappings handled? In client mode I would expect that drivers volumes have to mapped manually in the pod template. Executor volumes are attached dynamically based on submit parameters. Right...? I cluster mode I would expect that volumes