Have you checked the contents of __app__.jar ?
> On Sep 9, 2015, at 3:28 AM, Tom Seddon wrote:
>
> Thanks for your reply Aniket.
>
> Ok I've done this and I'm still confused. Output from running locally shows:
>
> file:/home/tom/spark-avro/target/scala-2.10/simpleapp.jar
> file:/home/tom/sp
Thanks for your reply Aniket.
Ok I've done this and I'm still confused. Output from running locally
shows:
file:/home/tom/spark-avro/target/scala-2.10/simpleapp.jar
file:/home/tom/spark-1.4.0-bin-hadoop2.4/conf/
file:/home/tom/spark-1.4.0-bin-hadoop2.4/lib/spark-assembly-1.4.0-hadoop2.4.0.jar
fi
Hi Tom
There has to be a difference in classpaths in yarn-client and yarn-cluster
mode. Perhaps a good starting point would be to print classpath as a first
thing in SimpleApp.main. It should give clues around why it works in
yarn-cluster mode.
Thanks,
Aniket
On Wed, Sep 9, 2015, 2:11 PM Tom Sed
Hi,
I have a problem trying to get a fairly simple app working which makes use
of native avro libraries. The app runs fine on my local machine and in
yarn-cluster mode, but when I try to run it on EMR yarn-client mode I get
the error below. I'm aware this is a version problem, as EMR runs an
ear
