Here is the PR https://github.com/apache/spark/pull/997
2014-06-03 19:24 GMT+02:00 Patrick Wendell :
> You can set an arbitrary properties file by adding --properties-file
> argument to spark-submit. It would be nice to have spark-submit also
> look in SPARK_CONF_DIR as well by default. If you o
You can set an arbitrary properties file by adding --properties-file
argument to spark-submit. It would be nice to have spark-submit also
look in SPARK_CONF_DIR as well by default. If you opened a JIRA for
that I'm sure someone would pick it up.
On Tue, Jun 3, 2014 at 7:47 AM, Eugen Cepoi wrote:
Is it on purpose that when setting SPARK_CONF_DIR spark submit still loads
the properties file from SPARK_HOME/conf/spark-defauls.conf ?
IMO it would be more natural to override what is defined in SPARK_HOME/conf
by SPARK_CONF_DIR when defined (and SPARK_CONF_DIR being overriden by
command line ar
