This is resolved now
On Thu, Sep 24, 2015 at 7:47 PM Doug Balog wrote:
> The error is because the shell is trying to resolve hdp.version and can’t.
> To fix this, you need to put a file called java-opts in your conf
> directory that has something like this.
>
> -Dhdp.version=2.x.x.x
>
> Where 2.
The error is because the shell is trying to resolve hdp.version and can’t.
To fix this, you need to put a file called java-opts in your conf directory
that has something like this.
-Dhdp.version=2.x.x.x
Where 2.x.x.x is there version of hdp that you are using.
Cheers,
Doug
> On Sep 24, 2015,
Spark 1.4.1
YARN
Hadoop version: 2.7.1.2.3.1.0-2574
./bin/spark-shell --master yarn
Hadoop cluster setup using Ambari.
Shell fails as YARN job failed. Any suggestions ?
LOGS:
15/09/24 15:07:51 INFO impl.YarnClientImpl: Submitted application
application_1443126834156_0016
15/09/24 15:07:52 INFO