Re: [SPARK-16654][CORE][WIP] Add UI coverage for Application Level Blacklisting

2016-11-22 Thread Jose Soltren
#x27;s branch for the pull request. > > On Mon, Nov 21, 2016 at 7:33 PM Jose Soltren wrote: >> >> Hi - I'm proposing a patch set for UI coverage of Application Level >> Blacklisting: >> >> https://github.com/jsoltren/spark/pull/1 >> >> T

Total memory tracking: request for comments

2017-06-20 Thread Jose Soltren
https://issues.apache.org/jira/browse/SPARK-21157 Hi - often times, Spark applications are killed for overrunning available memory by YARN, Mesos, or the OS. In SPARK-21157, I propose a design for grabbing and reporting "total memory" usage for Spark executors - that is, memory usage as visible fr