I've 2 questions: 1) how to raise the number of reducers? 2) why are there only 2 bucket files per partition even though I specified 32 buckets?
I've set the following and don't see an increase in the number of reducers. >>set hive.exec.reducers.max=32; >>set mapred.reduce.tasks=32; Could this be because the jobs are too small? I have a feeling that this is the cause for my having only 2 bucket files in each partition, inspite of specifing 32 buckets. -Ajo.