zeppelin's py4j conflicts with spark's

2021-03-25 Thread Rui Lu
Hi all, I’m trying to switch from pyspark interpreter to python interpreter and ran into weird errors of py4j like “key error ‘x’” or “invalid command” or so when creating spark session. A little digging reveals that zeppelin has its own py4j stuffed into PYTHONPATH of python interpreter, the val

Re: zeppelin's py4j conflicts with spark's

2021-04-01 Thread Rui Lu
nterpreter initialisation added its own py4j. I'm using zeppelin 0.8.2 from AWS EMR. Regards -Lu Rui On Fri, Apr 2, 2021 at 9:05 AM Jeff Zhang wrote: > Could you share how do you include pyspark's py4j to python interpreter ? > > Rui Lu 于2021年3月25日周四 下午10:49写道: > >> Hi all, &