Re: External Shuffle service over yarn

2015-06-26 Thread Aaron Davidson
>> >> Can someone point out if there are any distinct advantages of using >> external shuffle service over yarn (runs on node manager as an auxiliary >> service >> >> https://issues.apache.org/jira/browse/SPARK-3797) instead of the >> default executi

Re: External Shuffle service over yarn

2015-06-25 Thread Sandy Ryza
if there are any distinct advantages of using > external shuffle service over yarn (runs on node manager as an auxiliary > service > > https://issues.apache.org/jira/browse/SPARK-3797) instead of the default > execution in the executor containers ? > > Please also mention if

External Shuffle service over yarn

2015-06-25 Thread yash datta
Hi devs, Can someone point out if there are any distinct advantages of using external shuffle service over yarn (runs on node manager as an auxiliary service https://issues.apache.org/jira/browse/SPARK-3797) instead of the default execution in the executor containers ? Please also mention if