A second advantage is that it allows individual Executors to go into GC
pause (or even crash) and still allow other Executors to read shuffle data
and make progress, which tends to improve stability of memory-intensive
jobs.
On Thu, Jun 25, 2015 at 11:42 PM, Sandy Ryza
wrote:
> Hi Yash,
>
> One
Hi Yash,
One of the main advantages is that, if you turn dynamic allocation on, and
executors are discarded, your application is still able to get at the
shuffle data that they wrote out.
-Sandy
On Thu, Jun 25, 2015 at 11:08 PM, yash datta wrote:
> Hi devs,
>
> Can someone point out if there a
