Re: spark on yarn succeeds but exit code 1 in logs

it is CDH 5.3 with the spark that ships with it. i went through the RM logs line by line, and i found the exit code in there: container_1422728945460_0001_01_29 Container Transitioned from NEW to RESERVED 2015-01-31 18:30:49,633 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fai

Re: spark on yarn succeeds but exit code 1 in logs

Can you look inside RM log to see if you can find some clue there ? You can pastebin part of the RM log around the time your job ran ? What hadoop version are you using ? Thanks On Sat, Jan 31, 2015 at 11:24 AM, Koert Kuipers wrote: > i have a simple spark app that i run with spark-submit on

spark on yarn succeeds but exit code 1 in logs

i have a simple spark app that i run with spark-submit on yarn. it runs fine and shows up with finalStatus=SUCCEEDED in the resource manager logs. however in the nodemanager logs i see this: 2015-01-31 18:30:48,195 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.Containers