Re: Unable to start spark-shell on YARN

2015-09-24 Thread ๏̯͡๏
This is resolved now On Thu, Sep 24, 2015 at 7:47 PM Doug Balog wrote: > The error is because the shell is trying to resolve hdp.version and can’t. > To fix this, you need to put a file called java-opts in your conf > directory that has something like this. > > -Dhdp.version=2.x.x.x > > Where 2.

Re: Unable to start spark-shell on YARN

2015-09-24 Thread Doug Balog
The error is because the shell is trying to resolve hdp.version and can’t. To fix this, you need to put a file called java-opts in your conf directory that has something like this. -Dhdp.version=2.x.x.x Where 2.x.x.x is there version of hdp that you are using. Cheers, Doug > On Sep 24, 2015,

Unable to start spark-shell on YARN

2015-09-24 Thread ๏̯͡๏
Spark 1.4.1 YARN Hadoop version: 2.7.1.2.3.1.0-2574 ./bin/spark-shell --master yarn Hadoop cluster setup using Ambari. Shell fails as YARN job failed. Any suggestions ? LOGS: 15/09/24 15:07:51 INFO impl.YarnClientImpl: Submitted application application_1443126834156_0016 15/09/24 15:07:52 INFO