This is likely the cause as I replaced cdh-manager deployment (1.3.0 spark) with a compiled 1.6.0.
On 1/13/16, 10:06 AM, "Marcelo Vanzin" <van...@cloudera.com> wrote: >SparkSubmitDriverBootstrapper was removed back in Spark 1.4, so it >seems you have a mixbag of 1.3 / 1.6 in your path / classpath and >things are failing because of that. > >On Wed, Jan 13, 2016 at 9:31 AM, Lin Zhao <l...@exabeam.com> wrote: >> My job runs fine in yarn cluster mode but I have reason to use client >>mode >> instead. But I'm hitting this error when submitting: >>> spark-submit --class com.exabeam.martini.scripts.SparkStreamingTest >>> --master yarn --deploy-mode client --executor-memory 90G >>>--num-executors 3 >>> --executor-cores 14 Martini-assembly-0.1.jar yarn-client >> >> Error: Could not find or load main class >> org.apache.spark.deploy.SparkSubmitDriverBootstrapper >> >> >> If I replace deploy-mode to cluster the job is submitted successfully. >>Is >> there a dependency missing from my project? Right now only one I >>included is >> spark-streaming 1.6.0. > > > >-- >Marcelo --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
