Hi all,
There are ways through the `addArtifacts` API in an existing session but
for that we need to have dependencies properly gzipped. In the case of
different kernel/OS between client and server, it won't work either I
believe. What I am interested in is doing some sort of `pip install
https://y
Hi,
I see that Spark Context methods are not supported in Spark Connect. There
are many common use cases eg. broadcast machine learning model weights to
all executors, so no need to fetch individually.
This makes migration of workloads to Spark Connect tougher. I know there
are plans to add more &