Re: Difference between spark-defaults.conf and SparkConf.set

2015-07-01 Thread yana
r replying Original message From: Akhil Das Date:07/01/2015 2:27 AM (GMT-05:00) To: Yana Kadiyska Cc: user@spark.apache.org Subject: Re: Difference between spark-defaults.conf and SparkConf.set .addJar works for me when i run it as a stand-alone application (without using sp

Re: Difference between spark-defaults.conf and SparkConf.set

2015-06-30 Thread Akhil Das
.addJar works for me when i run it as a stand-alone application (without using spark-submit) Thanks Best Regards On Tue, Jun 30, 2015 at 7:47 PM, Yana Kadiyska wrote: > Hi folks, running into a pretty strange issue: > > I'm setting > spark.executor.extraClassPath > spark.driver.extraClassPath >

Difference between spark-defaults.conf and SparkConf.set

2015-06-30 Thread Yana Kadiyska
Hi folks, running into a pretty strange issue: I'm setting spark.executor.extraClassPath spark.driver.extraClassPath to point to some external JARs. If I set them in spark-defaults.conf everything works perfectly. However, if I remove spark-defaults.conf and just create a SparkConf and call .set(