Denis RP <qq378789...@gmail.com> writes: > I build it with sbt package, I run it with sbt run, and I do use > SparkConf.set for deployment options and external jars. It seems that > spark-submit can't load extra jars and will lead to noclassdeffounderror, > should I pack all the jars to a giant one and give it a try?
Yeah, it might be worth trying to use spark-submit. I think SparkConf#setJars should load the JARs properly, but spark-submit is the standard way, so it would be good to try that. > BTW, is there a chance that bagel can work fine? The problem doesn't appear to be specific to GraphX, but it would be interesting to make sure. It shouldn't be too hard to port your shortest path code over to Bagel... Ankur
