mstag, 4. Dezember 2021 18:36
> *To:* Bode, Meikel, NMA-CFD
> *Cc:* dev ; user@spark.apache.org
> *Subject:* Re: Conda Python Env in K8S
>
>
>
>
> Hi Meikel
>
>
>
> In the past I tried with
>
>
>
>--py-files
> hdfs://$HDFS_HOST:$HDFS_P
RK-33530
>
> https://issues.apache.org/jira/browse/SPARK-33615
>
>
>
> Best,
>
> Meikel
>
>
>
>
>
> *From:* Mich Talebzadeh
> *Sent:* Samstag, 4. Dezember 2021 18:36
> *To:* Bode, Meikel, NMA-CFD
> *Cc:* dev ; user@spark.apache.org
> *Subject:* R
RK-33615
Best,
Meikel
From: Mich Talebzadeh
Sent: Samstag, 4. Dezember 2021 18:36
To: Bode, Meikel, NMA-CFD
Cc: dev ; user@spark.apache.org
Subject: Re: Conda Python Env in K8S
Hi Meikel
In the past I tried with
--py-files hdfs://$HDFS_HOST:$HDFS_PORT/minikube/codes/
and I want to understand what the issue
> is…
>
> Any hints on that?
>
>
>
> Best,
>
> Meikel
>
>
>
> *From:* Mich Talebzadeh
> *Sent:* Freitag, 3. Dezember 2021 13:27
> *To:* Bode, Meikel, NMA-CFD
> *Cc:* dev ; user@spark.apache.org
> *Subject:*
ist and I want to understand what the issue
> is…
>
> Any hints on that?
>
>
>
> Best,
>
> Meikel
>
>
>
> *From:* Mich Talebzadeh
> *Sent:* Freitag, 3. Dezember 2021 13:27
> *To:* Bode, Meikel, NMA-CFD
> *Cc:* dev ; user@spark.apache.org
> *Subject:* Re
these options exist and I want to understand what the issue is...
Any hints on that?
Best,
Meikel
From: Mich Talebzadeh
Sent: Freitag, 3. Dezember 2021 13:27
To: Bode, Meikel, NMA-CFD
Cc: dev ; user@spark.apache.org
Subject: Re: Conda Python Env in K8S
Build python packages into the docker
Build python packages into the docker image itself first with pip install
RUN pip install panda . . —no-cache
HTH
On Fri, 3 Dec 2021 at 11:58, Bode, Meikel, NMA-CFD <
meikel.b...@bertelsmann.de> wrote:
> Hello,
>
>
>
> I am trying to run spark jobs using Spark Kubernetes Operator.
>
> But when
Hello,
I am trying to run spark jobs using Spark Kubernetes Operator.
But when I try to bundle a conda python environment using the following
resource description the python interpreter is only unpack to the driver and
not to the executors.
apiVersion: "sparkoperator.k8s.io/v1beta2"
kind: Spark
