Re: python virtual environment on spark interpreter

2019-08-19 Thread Jeff Zhang
Use PYSPARK_PYTHON or spark.pyspark.python Here's more details https://www.zepl.com/viewer/notebooks/bm90ZTovL3pqZmZkdS9lNDYzY2NjMmRkODM0NTcwYjFiZTgwMzViMTBmNTUxZi9ub3RlLmpzb24 Manuel Sopena Ballesteros 于2019年8月20日周二 上午7:57写道: > Dear Zeppelin user community, > > > > I have a zeppelin installat

python virtual environment on spark interpreter

2019-08-19 Thread Manuel Sopena Ballesteros
Dear Zeppelin user community, I have a zeppelin installation connected to a Spark cluster. I setup Zeppelin to submit jobs in yarn cluster mode and also impersonation is enabled. Now I would like to be able to use a python virtual environment instead of system one. Is there a way I could specify