Hi, Even I am encountering the same problem and exactly the same console logs while running custom Spark programs using YARN. I have checked all the information provided elsewhere and confirmed the same in my system: *- Set HADOOP_CONF_DIR=/etc/hadoop/conf - Set YARN_CONF_DIR=/etc/hadoop/conf - Set SPARK_YARN_USER_ENV="CLASSPATH=/etc/hadoop/conf/"*
I have set the above in the *spark-env.sh* as well as exported them in the file */etc/profile* on all machines in the cluster. Still I am getting the same problem. However, the Spark example programs are running fine on YARN. Please provide suggestions in order to resolve this issue. Regards, Gaurav -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Yarn-configuration-file-doesn-t-work-when-run-with-yarn-client-mode-tp1418p6088.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
