That's the first thing I tried... still the same error: hdfs@ams-rsrv01:~$ export CLASSPATH=/tmp/spark/spark-branch-1.1/lib hdfs@ams-rsrv01:~$ cd /tmp/spark/spark-branch-1.1 hdfs@ams-rsrv01:/tmp/spark/spark-branch-1.1$ ./bin/spark-shell
Spark assembly has been built with Hive, including Datanucleus jars on classpath Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/deploy/SparkSubmit Caused by: java.lang.ClassNotFoundException: org.apache.spark.deploy.SparkSubmit at java.net.URLClassLoader$1.run(URLClassLoader.java:217) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at java.lang.ClassLoader.loadClass(ClassLoader.java:323) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) at java.lang.ClassLoader.loadClass(ClassLoader.java:268) Could not find the main class: org.apache.spark.deploy.SparkSubmit. Program will exit. Thanks, Daniel On Tue, Dec 16, 2014 at 1:53 PM, Akhil Das <ak...@sigmoidanalytics.com> wrote: > > print the CLASSPATH and make sure the spark assembly jar is there in the > classpath > > Thanks > Best Regards > > On Tue, Dec 16, 2014 at 5:04 PM, Daniel Haviv <danielru...@gmail.com> > wrote: >> >> Hi, >> I've built spark successfully with maven but when I try to run >> spark-shell I get the following errors: >> >> Spark assembly has been built with Hive, including Datanucleus jars on >> classpath >> >> Exception in thread "main" java.lang.NoClassDefFoundError: >> org/apache/spark/deploy/SparkSubmit >> >> Caused by: java.lang.ClassNotFoundException: >> org.apache.spark.deploy.SparkSubmit >> >> at java.net.URLClassLoader$1.run(URLClassLoader.java:217) >> >> at java.security.AccessController.doPrivileged(Native Method) >> >> at java.net.URLClassLoader.findClass(URLClassLoader.java:205) >> >> at java.lang.ClassLoader.loadClass(ClassLoader.java:323) >> >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)at >> java.lang.ClassLoader.loadClass(ClassLoader.java:268)Could not find the >> main class: org.apache.spark.deploy.SparkSubmit. Program will exit. >> What can be wrong? >> >> Thanks, >> Daniel >> >