Re: switching between python2 and 3 for %pyspark

2018-10-26 Thread Jeff Zhang
IIUC, You change the source code spark interpreter by adding another py3spark interpreter, is that right ? >>> Nevertheless, zeppelin_ipythonxxx/ipython_server.py >>> seems catching environment variable from zeppelin-env.sh and not from interpreter settings. zeppelin will read env from both zeppel

Re: switching between python2 and 3 for %pyspark

2018-10-26 Thread Ruslan Dautkhanov
Thanks Jeff , yep that's what we have too in [1] - that's what we have currently in interpreter settings now. It doesn't work for some reason. We're running Zeppelin from ~May'18 snapshot - has anything changed since then? Ruslan [1] LD_LIBRARY_PATH /opt/cloudera/parcels/Anaconda3/lib PATH

Re: switching between python2 and 3 for %pyspark

2018-10-26 Thread Jeff Zhang
Hi Ruslan, I believe you can just set PYSPARK_PYTHON in spark interpreter setting to switch between python2 and python3 Ruslan Dautkhanov 于2018年10月27日周六 上午2:26写道: > I'd like to give users ability to switch between Python2 and Python3 for > their PySpark jobs. > Was somebody able to set up some