RE: PySpark to remote cluster

2016-12-01 Thread Schaefers, Klaus
December 1, 2016 12:44 AM To: user@spark.apache.org; Schaefers, Klaus Subject: Re: PySpark to remote cluster Spark 2.0.1 is running with a different py4j library than Spark 1.6. You will probably run into other problems mixing versions though - is there a reason you can't run Spark 1.

Re: PySpark to remote cluster

2016-11-30 Thread Felix Cheung
Spark 2.0.1 is running with a different py4j library than Spark 1.6. You will probably run into other problems mixing versions though - is there a reason you can't run Spark 1.6 on the client? _ From: Klaus Schaefers mailto:klaus.schaef...@philips.com>> Sent: Wednes