Looks like PySpark can't initiate a JVM in the backend. How did you set
up Java and Spark on your machine? Some suggestions that may help solve
your issue:
1. Use OpenJDK instead of Apple JDK since Spark was developed using
OpenJDK, not Apple's. You can use homebrew to install OpenJDK (I
e error found
[error] (compile:compile) Compilation failed
Vineet
-Original Message-
From: Sean Owen [mailto:so...@cloudera.com]
Sent: Donnerstag, 28. August 2014 16:30
To: Hingorani, Vineet
Cc: user@spark.apache.org
Subject: Re: Spark-submit not running
You should set this as early as possible in
You should set this as early as possible in your program, before other
code runs.
On Thu, Aug 28, 2014 at 3:27 PM, Hingorani, Vineet
wrote:
> Thank you Sean and Guru for giving the information. Btw I have to put this
> line, but where should I add it? In my scala file below other ‘import …’
> lin
.@cloudera.com]
Sent: Donnerstag, 28. August 2014 15:16
To: Guru Medasani
Cc: Hingorani, Vineet; user@spark.apache.org
Subject: Re: Spark-submit not running
Yes, but I think at the moment there is still a dependency on Hadoop even when
not using it. See https://issues.apache.org/jira/browse/SPARK-2356
Thanks Sean.
Looks like there is a workaround as per the JIRA
https://issues.apache.org/jira/browse/SPARK-2356 .
http://qnalist.com/questions/4994960/run-spark-unit-test-on-windows-7.
May be that's worth a shot?
On Aug 28, 2014, at 8:15 AM, Sean Owen wrote:
> Yes, but I think at the moment t
Yes, but I think at the moment there is still a dependency on Hadoop even
when not using it. See https://issues.apache.org/jira/browse/SPARK-2356
On Thu, Aug 28, 2014 at 2:14 PM, Guru Medasani wrote:
> Can you copy the exact spark-submit command that you are running?
>
> You should be able to r
cial site says that it is available on Windows,
> I added Java path in the PATH variable.
>
> Vineet
>
> From: Sean Owen [mailto:so...@cloudera.com]
> Sent: Donnerstag, 28. August 2014 13:49
> To: Hingorani, Vineet
> Cc: user@spark.apache.org
> Subject: Re: Spark-subm
[mailto:so...@cloudera.com]
Sent: Donnerstag, 28. August 2014 13:49
To: Hingorani, Vineet
Cc: user@spark.apache.org
Subject: Re: Spark-submit not running
You need to set HADOOP_HOME. Is Spark officially supposed to work on Windows or
not at this stage? I know the build doesn't quite yet.
On Thu
You need to set HADOOP_HOME. Is Spark officially supposed to work on
Windows or not at this stage? I know the build doesn't quite yet.
On Thu, Aug 28, 2014 at 11:37 AM, Hingorani, Vineet <
vineet.hingor...@sap.com> wrote:
> The file is compiling properly but when I try to run the jar file using
