RE: how to disable mapred.reduce.tasks

2011-07-01 Thread Steven Wong
ault value. By setting this property to -1, Hive will automatically figure out what should be the number of reducers. From: Igor Tatarinov [mailto:i...@decide.com] Sent: Wednesday, June 29, 2011 4:16 PM To: user@hive.apache.org Subject: how to disable mapred.reduce.tasks I set mapred.re

how to disable mapred.reduce.tasks

2011-06-29 Thread Igor Tatarinov
I set mapred.reduce.tasks manually to have a single wave of reducers (does that make sense, by the way?) When I save the data, I often end up with a bunch of small files because we use compression and Hive doesn't seem to merge small compressed files. So my question is: can I disable mapred.reduc