Try to start aws EMR 4.2.0 with hadoop and spark applications on spot
instances. Then look at how hadoop and spark configured. Try to configure
your hadoop and spark similar way
On Dec 17, 2015 6:09 PM, "Saisai Shao" wrote:
> Please check the Yarn AM log to see why AM is failed to start. That's t
Please check the Yarn AM log to see why AM is failed to start. That's the
reason why using `sc` will get such complaint.
On Fri, Dec 18, 2015 at 4:25 AM, Eran Witkon wrote:
> Hi,
> I am trying to install spark 1.5.2 on Apache hadoop 2.6 and Hive and yarn
>
> spark-env.sh
> export HADOOP_CONF_DIR
Hi,
I am trying to install spark 1.5.2 on Apache hadoop 2.6 and Hive and yarn
spark-env.sh
export HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop
bash_profile
#HADOOP VARIABLES START
export JAVA_HOME=/usr/lib/jvm/java-8-oracle/
export HADOOP_INSTALL=/usr/local/hadoop
export PATH=$PATH:$HADOOP_INSTAL
