Dear allI had install spark 1.2.1 in centos 6.6 x64. I run the
NetworkWordcount example and it works.But when I paste the same code to the
Intellij , packet to a jar and execute it.It Always occurs the following
exceptionException in thread "main" java.lang.NoSuchMethodError:
org.apache.spark.streaming.dstream.DStream$.toPairDStreamFunctions(Lorg/apache/spark/streaming/dstream/DStream;Lscala/reflect/ClassTag;Lscala/reflect/ClassTag;Lscala/math/Ordering;)Lorg/apache/spark/streaming/dstream/PairDStreamFunctions;
at com.test.SparkStreamingApp$.main(SparkStreamingApp.scala:25) at
com.test.SparkStreamingApp.main(SparkStreamingApp.scala) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606) at
org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358) at
org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75) at
org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)But I confirm the
package had been import in the code.import
org.apache.spark.streaming.StreamingContext._import org.apache.spark._import
org.apache.spark.streaming.{Seconds, StreamingContext}I struggle in this
issue long time. Are there anyone can give me some suggestion?Thank you!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/toPairDStreamFunctions-method-not-found-tp22617.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
