Hello, I usually create different python virtual environments for different projects to avoid version conflicts and skip the requirement to be root to install libs.
How can I specify to pyspark to activate a virtual environment before executing the tasks ? Further info on virtual envs: http://virtualenv.readthedocs.org/en/latest/virtualenv.html Thanks in advance, Christian