Re: Spark 1.2 + Avro does not work in HDP2.2

2014-12-16 Thread Sean Owen
Given that the error is java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected ...this usually means there is a Hadoop version problem. But in particular it's https://issues.apache.org/jira/browse/SPARK-3039 which affects as

Re: Spark 1.2 + Avro does not work in HDP2.2

2014-12-16 Thread manasdebashiskar
Hi All, I saw some helps online about forcing avro-mapred to hadoop2 using classifiers. Now my configuration is thus val avro= "org.apache.avro" % "avro-mapred" % V.avro classifier "hadoop2" How ever I still get java.lang.IncompatibleClassChangeError. I think I am not building sp