Hi Stuti 2016-03-15 10:08 GMT+01:00 Stuti Awasthi <stutiawas...@hcl.com>:
> Thanks Prabhu, > > I tried starting in local mode but still picking Python 2.6 only. I have > exported “DEFAULT_PYTHON” in my session variable and also included in PATH. > > > > Export: > > export DEFAULT_PYTHON="/home/stuti/Python/bin/python2.7" > > export PATH="/home/stuti/Python/bin/python2.7:$PATH > DEFAULT_PYTHON is overwritten in pyspark. Have you tried setting PYSPARK_PYTHON to your Python executable like $ export PYSPARK_PYTHON="/home/stuti/Python/bin/python2.7" If that's not working, what's the output of $ printenv | sort and in pyspark: >>> import os >>> for k, v in sorted(os.environ.items()): ... print k, v ? Best Eike
