Hi Azuryy, This is what I got:
LogType: stderr LogLength: 85 Log Contents: Error: Could not find or load main class org.apache.spark.deploy.yarn.WorkerLauncher LogType: stdout LogLength: 0 Log Contents: That made me thought about the consolidated jar file that I was including. It was a simple mistake, I was including the following jar: assembly/target/spark-assembly_2.10-0.9.0-incubating.jar instead of: assembly/target/scala-2.10/spark-assembly_2.10-0.9.0-incubating-hadoop2.2.0.jar my bad, thank you very much for the help!! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-in-YARN-HDP-problem-tp2041p2075.html Sent from the Apache Spark User List mailing list archive at Nabble.com.