seem to
be missing in many cases and result in FetchFailure errors. I should
probably also mention that I have the spark.storage.memoryFraction set to
0.2.
From: Sandy Ryza
Date: Friday, November 21, 2014 at 1:41 PM
To: Brett Meyer
Cc: "user@spark.apache.org"
Subject: Re: Many r
Hi Brett,
Are you noticing executors dying? Are you able to check the YARN
NodeManager logs and see whether YARN is killing them for exceeding memory
limits?
-Sandy
On Fri, Nov 21, 2014 at 9:47 AM, Brett Meyer
wrote:
> I’m running a Python script with spark-submit on top of YARN on an EMR
> c
