Or you can increase the driver heap space (export _JAVA_OPTIONS="-Xmx5g")
Thanks
Best Regards
On Wed, Sep 2, 2015 at 11:57 PM, Mike Hynes <91m...@gmail.com> wrote:
> Just a thought; this has worked for me before on standalone client
> with a similar OOM error in a driver thread. Try setting:
> e
Just a thought; this has worked for me before on standalone client
with a similar OOM error in a driver thread. Try setting:
export SPARK_DAEMON_MEMORY=4G #or whatever size you can afford on your machine
in your environment/spark-env.sh before running spark-submit.
Mike
On 9/2/15, ankit tyagi wro
