This error I see locally. On Tue, Nov 17, 2015 at 5:44 PM, Tathagata Das <[email protected]> wrote:
> Are you running 1.5.2-compiled jar on a Spark 1.5.2 cluster? > > On Tue, Nov 17, 2015 at 5:34 PM, swetha <[email protected]> wrote: > >> >> >> Hi, >> >> I see java.lang.NoClassDefFoundError after changing the Streaming job >> version to 1.5.2. Any idea as to why this is happening? Following are my >> dependencies and the error that I get. >> >> <dependency> >> <groupId>org.apache.spark</groupId> >> <artifactId>spark-core_2.10</artifactId> >> <version>${sparkVersion}</version> >> <scope>provided</scope> >> </dependency> >> >> >> <dependency> >> <groupId>org.apache.spark</groupId> >> <artifactId>spark-streaming_2.10</artifactId> >> <version>${sparkVersion}</version> >> <scope>provided</scope> >> </dependency> >> >> >> <dependency> >> <groupId>org.apache.spark</groupId> >> <artifactId>spark-sql_2.10</artifactId> >> <version>${sparkVersion}</version> >> <scope>provided</scope> >> </dependency> >> >> >> <dependency> >> <groupId>org.apache.spark</groupId> >> <artifactId>spark-hive_2.10</artifactId> >> <version>${sparkVersion}</version> >> <scope>provided</scope> >> </dependency> >> >> >> >> <dependency> >> <groupId>org.apache.spark</groupId> >> <artifactId>spark-streaming-kafka_2.10</artifactId> >> <version>${sparkVersion}</version> >> </dependency> >> >> >> Exception in thread "main" java.lang.NoClassDefFoundError: >> org/apache/spark/streaming/StreamingContext >> at java.lang.Class.getDeclaredMethods0(Native Method) >> at java.lang.Class.privateGetDeclaredMethods(Class.java:2693) >> at java.lang.Class.privateGetMethodRecursive(Class.java:3040) >> at java.lang.Class.getMethod0(Class.java:3010) >> at java.lang.Class.getMethod(Class.java:1776) >> at >> com.intellij.rt.execution.application.AppMain.main(AppMain.java:125) >> Caused by: java.lang.ClassNotFoundException: >> org.apache.spark.streaming.StreamingContext >> at java.net.URLClassLoader$1.run(URLClassLoader.java:372) >> at java.net.URLClassLoader$1.run(URLClassLoader.java:361) >> at java.security.AccessController.doPrivileged(Native Method) >> at java.net.URLClassLoader.findClass(URLClassLoader.java:360) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:424) >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:357) >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Streaming-Job-gives-error-after-changing-to-version-1-5-2-tp25406.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] >> >> >
