> On Thu, Feb 5, 2015 at 12:49 PM, Felix C
> wrote:
>
>> Is YARN_CONF_DIR set?
>>
>> --- Original Message ---
>>
>> From: "Aniket Bhatnagar"
>> Sent: February 4, 2015 6:16 AM
>> To: "kundan kumar" , "spark users" <
red to the standalone mode.
Regards,
Kundan
On Thu, Feb 5, 2015 at 12:49 PM, Felix C wrote:
> Is YARN_CONF_DIR set?
>
> --- Original Message ---
>
> From: "Aniket Bhatnagar"
> Sent: February 4, 2015 6:16 AM
> To: "kundan kumar" , "spark users" &
Is YARN_CONF_DIR set?
--- Original Message ---
From: "Aniket Bhatnagar"
Sent: February 4, 2015 6:16 AM
To: "kundan kumar" , "spark users"
Subject: Re: Spark Job running on localhost on yarn cluster
Have you set master in SparkConf/SparkContext in your code? Driv
1) Parameters like "--num-executors" should come before the jar. That is, you
want something like$SPARK_HOME --num-executors 3 --driver-memory 6g
--executor-memory 7g \--master yarn-cluster --class EDDApp
target/scala-2.10/eddjar \
That is, *your* parameters come after the jar, spark's par
Have you set master in SparkConf/SparkContext in your code? Driver logs
show in which mode the spark job is running. Double check if the logs
mention local or yarn-cluster.
Also, what's the error that you are getting?
On Wed, Feb 4, 2015, 6:13 PM kundan kumar wrote:
> Hi,
>
> I am trying to exec
