Re: Proper utilization of Map and reduce

2012-01-12 Thread Aniket Mokashi
Hi, Can this be because of the scheduler you are using? I see there are 3 queues, check the scheduler configuration, that might give you some hints. Thanks, Aniket On Thu, Jan 12, 2012 at 12:24 AM, hadoop hive wrote: > thanks for your reply bejoy > > Actually there is nothing like rack awarene

Re: Proper utilization of Map and reduce

2012-01-12 Thread hadoop hive
thanks for your reply bejoy Actually there is nothing like rack awareness(actually they are on default rack), sometime there are also some reducers when required by query, i m running jobs through hive cli, you can suggest me some R&D so that i can check wat is actually going on. Regards Vikas S

Re: Proper utilization of Map and reduce

2012-01-12 Thread Bejoy Ks
Hi Vikas    From the job tracker WebUI, looks like your job is just map only, ie there is no reduce tasks for your job. It is a hive job then if no reduce tasks are required for your query Hive sets the number of reduce tasks to zero at code level. The parameters set using -D at run time on