RE: Spark 1.4.0 pyspark and pylint breaking

2015-05-27 Thread Michael Nazario
I've done some investigation into what work needed to be done to keep the _types module named types. This isn't a relative / absolute path problem, but actually a problem with the way the tests were run. I've filed a jira ticket on it here: https://issues.apache.org/jira/browse/SPARK-7899) I a

RE: PySpark SPARK_CLASSPATH doesn't distribute jars to executors

2015-02-25 Thread Michael Nazario
Neither of those helped. I'm still getting a ClassNotFoundException on the workers. From: Denny Lee [denny.g@gmail.com] Sent: Tuesday, February 24, 2015 7:21 PM To: Michael Nazario; dev@spark.apache.org Subject: Re: PySpark SPARK_CLASSPATH doesn't

PySpark SPARK_CLASSPATH doesn't distribute jars to executors

2015-02-24 Thread Michael Nazario
Has anyone experienced a problem with the SPARK_CLASSPATH not distributing jars for PySpark? I have a detailed description of what I tried in the ticket below, and this seems like a problem that is not a configuration problem. The only other case I can think of is that configuration changed betw