some unix machine on
> different network.
>
>
>
> -Naveen.
>
>
>
> *From:* Akhil Das [mailto:ak...@sigmoidanalytics.com
> ]
> *Sent:* Monday, November 24, 2014 4:08 PM
> *To:* Naveen Kumar Pokala
> *Cc:* user@spark.apache.org
> *Subject:* Re: Submit Spark driver on Yarn
, 2014 4:08 PM
To: Naveen Kumar Pokala
Cc: user@spark.apache.org<mailto:user@spark.apache.org>
Subject: Re: Submit Spark driver on Yarn Cluster in client mode
You can export the hadoop configurations dir (export HADOOP_CONF_DIR=XXX) in
the environment and then submit it like:
./bin/spark-
You can export the hadoop configurations dir (export HADOOP_CONF_DIR=XXX) in
the environment and then submit it like:
./bin/spark-submit \
--class org.apache.spark.examples.SparkPi \
--master yarn-cluster \ # can also be `yarn-client` for client mode
--executor-memory 20G \
--num-executor
Hi,
I want to submit my spark program from my machine on a YARN Cluster in yarn
client mode.
How to specify al l the required details through SPARK submitter.
Please provide me some details.
-Naveen.
