Re: Yarn / mapreduce scheduling

2014-04-03 Thread Brad Childs
rackLocalContainers + > > offSwitchContainers); > > } > > > > In this routine you will find that data-local tasks are scheduled first, > > then rack-local and in then off-switch. > > > > After this you may find similar function in fairScheduler too. >

Yarn / mapreduce scheduling

2014-04-03 Thread Brad Childs
Sorry if this is the wrong list, i am looking for deep technical/hadoop source help :) How does job scheduling work on yarn framework for map reduce jobs? I see the yarn scheduler discussed here: https://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/YARN.html which leads me to