Thank you Sean and Guru for giving the information. Btw I have to put this
line, but where should I add it? In my scala file below other ‘import …’ lines
are written?
System.setProperty("hadoop.home.dir", "d:\\winutil\\")
Thank you
Vineet
From: Sean Owen [mailto:[email protected]]
Sent: Donnerstag, 28. August 2014 15:16
To: Guru Medasani
Cc: Hingorani, Vineet; [email protected]
Subject: Re: Spark-submit not running
Yes, but I think at the moment there is still a dependency on Hadoop even when
not using it. See https://issues.apache.org/jira/browse/SPARK-2356
On Thu, Aug 28, 2014 at 2:14 PM, Guru Medasani
<[email protected]<mailto:[email protected]>> wrote:
Can you copy the exact spark-submit command that you are running?
You should be able to run it locally without installing hadoop.
Here is an example on how to run the job locally.
# Run application locally on 8 cores
./bin/spark-submit \
--class org.apache.spark.examples.SparkPi \
--master local[8] \
/path/to/examples.jar \
100
