spark-submit actually works, thanks for the reply!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/the-pregel-operator-of-graphx-throws-NullPointerException-tp10865p10949.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Denis RP writes:
> I build it with sbt package, I run it with sbt run, and I do use
> SparkConf.set for deployment options and external jars. It seems that
> spark-submit can't load extra jars and will lead to noclassdeffounderror,
> should I pack all the jars to a giant one and give it a try?
Ye
I build it with sbt package, I run it with sbt run, and I do use
SparkConf.set for deployment options and external jars. It seems that
spark-submit can't load extra jars and will lead to noclassdeffounderror,
should I pack all the jars to a giant one and give it a try?
I run it on a cluster of 8 m
Denis RP writes:
> [error] (run-main-0) org.apache.spark.SparkException: Job aborted due to
> stage failure: Task 6.0:4 failed 4 times, most recent failure: Exception
> failure in TID 598 on host worker6.local: java.lang.NullPointerException
> [error] scala.collection.Iterator$$anon$11.n
