Re: SparkException: env SPARK_YARN_APP_JAR is not set

2014-05-04 Thread phoenix bai
according to the code, SPARK_YARN_APP_JAR is retrieved from system variables. and the key-value pairs you pass through to JavaSparkContext is isolated from system variables. so, you maybe should try setting it through System.setProperty(). thanks On Wed, Apr 23, 2014 at 6:05 PM, 肥肥 <19934...@qq.

SparkException: env SPARK_YARN_APP_JAR is not set

2014-04-23 Thread ????
I have a small program, which I can launch successfully by yarn client with yarn-standalon mode. the command look like this: (javac javac -classpath .:jars/spark-assembly-0.9.1-hadoop2.2.0.jar LoadTest.java) (jar cvf loadtest.jar LoadTest.class) SPARK_JAR=assembly/target/scala-2.10/spark-ass