And there is another scheduler, Dynamic Priority Scheduling, lurking in the backwater of 0.21.0 that allows users to 'bid' for additional time. Getting this back into current 1.x may be a great way to understand about scheduling:
http://svn.apache.org/viewvc/hadoop/common/tags/release-0.21.0/mapreduce/src/contrib/dynamic-scheduler/ Chris -----Original Message----- From: inelu nagamallikarjuna [mailto:malli3...@gmail.com] Sent: 21 April 2013 21:54 To: common-dev@hadoop.apache.org Subject: Re: Hadoop Scheduling Algorithm Hi, Addition to Sandy, there is one more scheduler called HOD (Hadoop on Demand). Please go through the following links to get more details on schedulers. HOD - http://hadoop.apache.org/docs/r1.1.2/hod_scheduler.html Fair - http://hadoop.apache.org/docs/r1.1.2/fair_scheduler.html Capacity - http://hadoop.apache.org/docs/r1.1.2/capacity_scheduler.html Thanks Naga On Mon, Apr 22, 2013 at 12:31 AM, Sandy Ryza <sandy.r...@cloudera.com>wrote: > Hi Amr, > > Hadoop contains the FIFO scheduler and two more advanced schedulers, > the capacity scheduler, developed at Yahoo, and the fair scheduler, > developed at Facebook. > > In Hadoop 2, the fair scheduler code is located in the > org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair package, > and the capacity scheduler code is located in the > org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity > package. > > -Sandy > > > On Sun, Apr 21, 2013 at 11:39 AM, Amr Mohammed > <amr.elkh...@hotmail.com > >wrote: > > > Please,can any one give me guidelines or help for improving hadoop > > performance by improving the scheduling algorithm andwhich classes > > are responsible for the scheduling > -- Thanks and Regards Nagamallikarjuna
