How to configure authentication from a pySpark client to a Spark Connect server ?

2023-11-05 Thread Xiaolong Wang
Hi, Our company is currently introducing the Spark Connect server to production. Most of the issues have been solved yet I don't know how to configure authentication from a pySpark client to the Spark Connect server. I noticed that there is some interceptor configs at the Scala client

Re: PySpark Client

2015-01-22 Thread Chris Beavers
bble up as EOFExceptions. Furthermore, this just seems like a very >> heavy weight way to set up a client. >> >> Does anyone have any suggestions for setting up a thin pyspark client on >> a node which doesn't necessarily conform to the homogeneity of the target >> Spark cluster? >> >> Best, >> Chris >> > >

Re: PySpark Client

2015-01-20 Thread Andrew Or
en bubble up as EOFExceptions. Furthermore, this just seems like a very > heavy weight way to set up a client. > > Does anyone have any suggestions for setting up a thin pyspark client on a > node which doesn't necessarily conform to the homogeneity of the target > Spark cluster? > > Best, > Chris >

PySpark Client

2015-01-20 Thread Chris Beavers
ython versions differ slightly, then I start to see a lot of opaque errors that often bubble up as EOFExceptions. Furthermore, this just seems like a very heavy weight way to set up a client. Does anyone have any suggestions for setting up a thin pyspark client on a node which doesn't n