Have you checked the contents of __app__.jar ?
> On Sep 9, 2015, at 3:28 AM, Tom Seddon wrote:
>
> Thanks for your reply Aniket.
>
> Ok I've done this and I'm still confused. Output from running locally shows:
>
> file:/home/tom/spark-avro/target/scala-2.10/simpleapp.jar
> file:/home/tom/sp
Thanks for your reply Aniket.
Ok I've done this and I'm still confused. Output from running locally
shows:
file:/home/tom/spark-avro/target/scala-2.10/simpleapp.jar
file:/home/tom/spark-1.4.0-bin-hadoop2.4/conf/
file:/home/tom/spark-1.4.0-bin-hadoop2.4/lib/spark-assembly-1.4.0-hadoop2.4.0.jar
fi
Hi Tom
There has to be a difference in classpaths in yarn-client and yarn-cluster
mode. Perhaps a good starting point would be to print classpath as a first
thing in SimpleApp.main. It should give clues around why it works in
yarn-cluster mode.
Thanks,
Aniket
On Wed, Sep 9, 2015, 2:11 PM Tom Sed