Hi,
driver and executor path does not work because its for the driver and
executor and not for the master and worker jvm. It works fine for
driver/executor but we want to add classes to the master/worker. The
SPARK_DIST_CLASSPATH looks good, will try this!
Thanks!
2016-03-02 18:35 GMT+01:00 Sume
On Wednesday 02 March 2016 09:39 PM,
Matthias Niehoff wrote:
no, not to driver and executor but to the master
and worker instances of the spark standalone cluster
Why exactly does adding jars to driver/executor extraClassPath not
Matthias,
Can you check appending the jars in LAUNCH_CLASSPATH of
spark-1.4.1/sbin/spark_class
2016-03-02 21:39 GMT+05:30 Matthias Niehoff :
> no, not to driver and executor but to the master and worker instances of
> the spark standalone cluster
>
> Am 2. März 2016 um 17:05 schrieb Igor Be
no, not to driver and executor but to the master and worker instances of
the spark standalone cluster
Am 2. März 2016 um 17:05 schrieb Igor Berman :
> spark.driver.extraClassPath
> spark.executor.extraClassPath
>
> 2016-03-02 18:01 GMT+02:00 Matthias Niehoff <
> matthias.nieh...@codecentric.de>:
spark.driver.extraClassPath
spark.executor.extraClassPath
2016-03-02 18:01 GMT+02:00 Matthias Niehoff :
> Hi,
>
> we want to add jars to the Master and Worker class path mainly for logging
> reason (we have a redis appender to send logs to redis -> logstash ->
> elasticsearch).
>
> While it is wo
