please add following three libraries to your class path. spark-streaming-twitter_2.10-1.0.0.jar twitter4j-core-3.0.3.jar twitter4j-stream-3.0.3.jar
On Thu, Aug 21, 2014 at 1:09 PM, danilopds <[email protected]> wrote: > Hi! > > I'm beginning with the development in Spark Streaming.. And I'm learning > with the examples available in the spark directory. There are several > applications and I want to make modifications. > > I can execute the TwitterPopularTags normally with command: > ./bin/run-example TwitterPopularTags <auth> > > So, > I moved the source code to a separate folder with the structure: > ./src/main/scala/ > > With the files: > -TwitterPopularTags > -TwitterUtils > -StreamingExamples > -TwitterInputDStream > > But when I run the command: > ./bin/spark-submit --class "TwitterPopularTags" --master local[4] > /<MY_DIR>/TwitterTest/target/scala-2.10/simple-project_2.10-1.0.jar <auth> > > I receive the following error: > Exception in thread "main" java.lang.NoClassDefFoundError: > twitter4j/auth/Authorization > at TwitterUtils$.createStream(TwitterUtils.scala:42) > at TwitterPopularTags$.main(TwitterPopularTags.scala:65) > at TwitterPopularTags.main(TwitterPopularTags.scala) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:303) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:55) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > Caused by: java.lang.ClassNotFoundException: twitter4j.auth.Authorization > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > ... 10 more > > This is my sbt build file: > name := "Simple Project" > > version := "1.0" > > scalaVersion := "2.10.4" > > libraryDependencies += "org.apache.spark" %% "spark-core" % "1.0.2" > > libraryDependencies += "org.apache.spark" %% "spark-streaming" % "1.0.2" > > libraryDependencies += "org.twitter4j" % "twitter4j-core" % "3.0.3" > > libraryDependencies += "org.twitter4j" % "twitter4j-stream" % "3.0.3" > > resolvers += "Akka Repository" at "http://repo.akka.io/releases/" > > Can anybody help me? > Thanks a lot! > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-Twitter-Example-Error-tp12600.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
