Re: [Connect] Install additional python packages after session creation

2025-01-26 Thread Hyukjin Kwon
k to work with Spark > connect? > > > > Thanks, > > Balaji > > > > *From:* Hyukjin Kwon > *Sent:* 25 January 2025 04:46 > *To:* Deependra Patel > *Cc:* dev@spark.apache.org > *Subject:* [EXTERNAL] Re: [Connect] Install additional python packages > a

RE: [Connect] Install additional python packages after session creation

2025-01-26 Thread Balaji Sudharsanam V
additional python packages after session creation That's me. It's not anywhere yet and it's WIP as mentioned in the talk. I'm still dealing with its design. On Sat, Jan 25, 2025 at 1: 00 AM Deependra Patel wrote: Hi all, There are ways through That's me. It's no

Re: [Connect] Install additional python packages after session creation

2025-01-24 Thread Hyukjin Kwon
That's me. It's not anywhere yet and it's WIP as mentioned in the talk. I'm still dealing with its design. On Sat, Jan 25, 2025 at 1:00 AM Deependra Patel wrote: > Hi all, > There are ways through the `addArtifacts` API in an existing session but > for that we need to have dependencies properly

[Connect] Install additional python packages after session creation

2025-01-24 Thread Deependra Patel
Hi all, There are ways through the `addArtifacts` API in an existing session but for that we need to have dependencies properly gzipped. In the case of different kernel/OS between client and server, it won't work either I believe. What I am interested in is doing some sort of `pip install https://y