Just a heads up I'm in the process of trying to upload the latest PySpark to PyPi (we are blocked on a tickets with the PyPi folks around file size but I'll follow up with them).
Relatedly PySpark is available in Conda-forge, currently 2.1.0 and there is a PR to update to 2.1.1 in process. Happy Python Spark adventures every one :) -- Cell : 425-233-8271 Twitter: https://twitter.com/holdenkarau
