HI ,
Can somebody help me with adding library dependencies in my build.sbt so
that the java.lang.NoClassDefFoundError issue can be resolved.
My sbt (only the dependencies part) ->
libraryDependencies ++= Seq(
"org.apache.spark" %% "spark-core" % "1.0.1" ,
"org.apache.spark" %% "spark-streaming" % "1.0.1" ,
"org.apache.spark" %% "spark-streaming-twitter" % "1.0.1"
)
The exception , I am getting ->
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/spark/streaming/twitter/TwitterUtils$ at
TwitterApp$.main(TwitterApp.scala:64)
at TwitterApp.main(TwitterApp.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:330)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
The command to submit the jar -> bin/spark-submit --class "TwitterApp"
--master local[4] twitterapp-project_2.10-1.0.jar
Thanks in advance.
Regards,
NIranjan