Spark unknown OpCode Error

2015-05-26 Thread Nikhil Muralidhar
Not sure if emails with attachments are discarded so re-sending this without the attachment. Hello, I am trying to run a spark job (which runs fine on the master node of the cluster), on a HDFS hadoop cluster using YARN. When I run the job which has a rdd.saveAsTextFile() line in it, I get the f

PySpark Unknown Opcode Error

2015-05-26 Thread Nikhil Muralidhar
Hello, I am trying to run a spark job (which runs fine on the master node of the cluster), on a HDFS hadoop cluster using YARN. When I run the job which has a rdd.saveAsTextFile() line in it, I get the following error: *SystemError: unknown opcode* The entire stacktrace has been appended to thi