Re: Using capacity scheduler

2011-05-02 Thread Sreekanth Ramakrishnan
: Hi Sreekanth, When you mention about setting the max task limit, do you mean by executing set mapred.capacity-scheduler.queue..maximum-capacity = ? Is it only available on hadoop 0.21? Thanks, Rosanna On 5/1/11 8:42 PM, "Sreekanth Ramakrishnan" wrote: The design goal of CapacitySc

Re: Using capacity scheduler

2011-05-01 Thread Sreekanth Ramakrishnan
rs for capacity scheduler to maximize the use of the resources. Basically, our goal is to maximize the resources (mappers and reducers) while providing a fair share to the short tasks while a big task is running. How do you normally achieve hat? Thanks, Rosanna On 4/28/11 8:09 PM, "Sreekanth

Re: Using capacity scheduler

2011-04-28 Thread Sreekanth Ramakrishnan
cheduler before but it gives an error when the mapper gives no output (which is fine in our use cases). Anyone can give us some advice? Thanks, Rosanna -- Sreekanth Ramakrishnan

Re: Regarding Number of Jobs Created for One Hive-Query

2011-01-03 Thread Sreekanth Ramakrishnan
tely and delete it! -- Sreekanth Ramakrishnan