Hi Vikas From the job tracker WebUI, looks like your job is just map only, ie there is no reduce tasks for your job. It is a hive job then if no reduce tasks are required for your query Hive sets the number of reduce tasks to zero at code level. The parameters set using -D at run time on CLI could be overridden at code level. I believe that is happening here. On the map tasks, there would be constrains taken here like data locality(rack locality etc). May be your data is not uniformly distributed across the cluster or so. Need detailed investigation, can't say in one look.
Regards Bejoy.K.S ________________________________ From: hadoop hive <hadooph...@gmail.com> To: user@hive.apache.org Sent: Thursday, January 12, 2012 12:13 PM Subject: Proper utilization of Map and reduce hey all, I have a cluster of 13 nodes, in which i configured map =16 and reduce=10 , and mapred.reduce.tasks=120 , replication factor=2 but still i wont be able to utilize map and reduce as shown in pic. Thanks in advance.. tell how can i make it utilize full map adn reduce. regards Vikas Srivastava
