++ Sudhir
On Wed, 15 Mar 2017 at 4:06 PM, Saurav Sinha
wrote:
> Hi Users,
>
>
> I am running spark job in yarn.
>
> I want to set staging directory to some other location which is by default
> hdfs://host:port/home/$User/
>
> In spark 2.0.0, it can be done by setting spark.yarn.stagingDir.
>
> B
Hi Users,
I am running spark job in yarn.
I want to set staging directory to some other location which is by default
hdfs://host:port/home/$User/
In spark 2.0.0, it can be done by setting spark.yarn.stagingDir.
But in production, we have spark 1.6. Can anyone please suggest how it can
be done
