One possible cause of a standalone master OOMing is
https://issues.apache.org/jira/browse/SPARK-6270. In 2.x, this will be
fixed by https://issues.apache.org/jira/browse/SPARK-12299. In 1.x, one
mitigation is to disable event logging. Another workaround would be to
produce a patch which disables e
Why would the spark master run out of RAM if I have too many slaves? Is
this a flaw in the coding? I'm just a user of spark. The developer that
set this up left the company, so I'm starting from the top here.
So I noticed if I spawn lots of jobs, my spark master ends up crashing due
to low memo
