Re: NodeManager heap size with ExternalShuffleService

Sure Reynold, Here is pull request - [YARN][DOC] Increasing NodeManager's heap size with External Shuffle Service On Wed, Nov 16, 2016, 04:07 Reynold Xin wrote: Can you submit a pull request to add that to the documentation? On November 15, 2016 at

Re: NodeManager heap size with ExternalShuffleService

Can you submit a pull request to add that to the documentation? On November 15, 2016 at 12:45:57 PM, Artur Sukhenko ( artur.sukhe...@gmail.com) wrote: Hello guys, When you enable ExternalShuffleService (spark-shuffle) in NodeManager, there are no suggestions of increasing NM heap size in Spark

NodeManager heap size with ExternalShuffleService

Hello guys, When you enable ExternalShuffleService (spark-shuffle) in NodeManager, there are no suggestions of increasing NM heap size in Spark docs or anywhere else, shouldn't we include this in spark's documentation? I have seen NM take a lot of memory 5+ gb with default 1g, and in case of its