I've had similar experiences ... usually with bucketing. Is this your experience too?
-Ajo On Thu, Feb 10, 2011 at 1:57 PM, Viral Bajaria <viral.baja...@gmail.com>wrote: > Hello, > > In my Hive cluster, I have setup the mapred.reduce.tasks to be -1 i.e. I am > allowing HIVE to figure out the # of reducers that it would need from the > data. > > When I run a query, it determines that it will need 4 reducers but when I > look at the MAPRED logs, I see that all the work is done by a single reducer > while the other 3 reducers forward 0 rows. Is this just bad planning on HIVE > side or am I missing something. > > Thanks, > Viral >
