Hi,
Our company is currently introducing the Spark Connect server to
production.
Most of the issues have been solved yet I don't know how to configure
authentication from a pySpark client to the Spark Connect server.
I noticed that there is some interceptor configs at the Scala client
bble up as EOFExceptions. Furthermore, this just seems like a very
>> heavy weight way to set up a client.
>>
>> Does anyone have any suggestions for setting up a thin pyspark client on
>> a node which doesn't necessarily conform to the homogeneity of the target
>> Spark cluster?
>>
>> Best,
>> Chris
>>
>
>
en bubble up as EOFExceptions. Furthermore, this just seems like a very
> heavy weight way to set up a client.
>
> Does anyone have any suggestions for setting up a thin pyspark client on a
> node which doesn't necessarily conform to the homogeneity of the target
> Spark cluster?
>
> Best,
> Chris
>
ython
versions differ slightly, then I start to see a lot of opaque errors that
often bubble up as EOFExceptions. Furthermore, this just seems like a very
heavy weight way to set up a client.
Does anyone have any suggestions for setting up a thin pyspark client on a
node which doesn't n