And this is how my classpath looks like Spark assembly has been built with Hive, including Datanucleus jars on classpath ::/home/akhld/mobi/localcluster/spark-1/conf:/home/akhld/mobi/localcluster/spark-1/lib/spark-assembly-1.1.0-hadoop1.0.4.jar:/home/akhld/mobi/localcluster/spark-1/lib/datanucleus-core-3.2.2.jar:/home/akhld/mobi/localcluster/spark-1/lib/datanucleus-rdbms-3.2.1.jar:/home/akhld/mobi/localcluster/spark-1/lib/datanucleus-api-jdo-3.2.1.jar
Thanks Best Regards On Tue, Dec 16, 2014 at 10:33 PM, Daniel Haviv <danielru...@gmail.com> wrote: > > Same here... > # jar tf lib/spark-assembly-1.1.2-SNAPSHOT-hadoop2.3.0.jar | grep > SparkSubmit.class > *org/apache/spark/deploy/SparkSubmit.class* > > > > > > > On Tue, Dec 16, 2014 at 6:50 PM, Akhil Das <ak...@sigmoidanalytics.com> > wrote: >> >> This is how it looks on my machine. >> >> [image: Inline image 1] >> >> Thanks >> Best Regards >> >> On Tue, Dec 16, 2014 at 9:33 PM, Daniel Haviv <danielru...@gmail.com> >> wrote: >>> >>> That's the first thing I tried... still the same error: >>> hdfs@ams-rsrv01:~$ export CLASSPATH=/tmp/spark/spark-branch-1.1/lib >>> hdfs@ams-rsrv01:~$ cd /tmp/spark/spark-branch-1.1 >>> hdfs@ams-rsrv01:/tmp/spark/spark-branch-1.1$ ./bin/spark-shell >>> >>> Spark assembly has been built with Hive, including Datanucleus jars on >>> classpath >>> Exception in thread "main" java.lang.NoClassDefFoundError: >>> org/apache/spark/deploy/SparkSubmit >>> Caused by: java.lang.ClassNotFoundException: >>> org.apache.spark.deploy.SparkSubmit >>> at java.net.URLClassLoader$1.run(URLClassLoader.java:217) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at java.net.URLClassLoader.findClass(URLClassLoader.java:205) >>> at java.lang.ClassLoader.loadClass(ClassLoader.java:323) >>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) >>> at java.lang.ClassLoader.loadClass(ClassLoader.java:268) >>> Could not find the main class: org.apache.spark.deploy.SparkSubmit. >>> Program will exit. >>> >>> Thanks, >>> Daniel >>> >>> On Tue, Dec 16, 2014 at 1:53 PM, Akhil Das <ak...@sigmoidanalytics.com> >>> wrote: >>>> >>>> print the CLASSPATH and make sure the spark assembly jar is there in >>>> the classpath >>>> >>>> Thanks >>>> Best Regards >>>> >>>> On Tue, Dec 16, 2014 at 5:04 PM, Daniel Haviv <danielru...@gmail.com> >>>> wrote: >>>>> >>>>> Hi, >>>>> I've built spark successfully with maven but when I try to run >>>>> spark-shell I get the following errors: >>>>> >>>>> Spark assembly has been built with Hive, including Datanucleus jars on >>>>> classpath >>>>> >>>>> Exception in thread "main" java.lang.NoClassDefFoundError: >>>>> org/apache/spark/deploy/SparkSubmit >>>>> >>>>> Caused by: java.lang.ClassNotFoundException: >>>>> org.apache.spark.deploy.SparkSubmit >>>>> >>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:217) >>>>> >>>>> at java.security.AccessController.doPrivileged(Native Method) >>>>> >>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:205) >>>>> >>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:323) >>>>> >>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)at >>>>> java.lang.ClassLoader.loadClass(ClassLoader.java:268)Could not find >>>>> the main class: org.apache.spark.deploy.SparkSubmit. Program will exit. >>>>> What can be wrong? >>>>> >>>>> Thanks, >>>>> Daniel >>>>> >>>>
