Ah, well, my bad. See instead the description for mapred.reduce.tasks
in mapred-default.xml, which states this: "Typically set to 99% of the
cluster's reduce capacity, so that if a node fails the reduces can
still be executed in a single wave."
FWIW, I set it manually to the level of parallelism I
hi harsh,
Thanks for the reply.I get your first and second points and coming to
third point how is it specific to a job?
My question was specific to job.
Regards
Abhishek
On Mon, Aug 27, 2012 at 11:29 PM, Harsh J wrote:
> Hi,
>
> On Tue, Aug 28, 2012 at 8:32 AM, Abhishek wrote:
>> Hi all,
>>
Hi,
On Tue, Aug 28, 2012 at 8:32 AM, Abhishek wrote:
> Hi all,
>
> I just want to know that, based on what factor map reduce framework decides
> number of reducers to launch for a job
The framework does not auto-determine the number of reducers for a
job. That is purely user-or-client-program-s
