g that path.
>
> Bikas
>
> -Original Message-
> From: go...@hortonworks.com [mailto:go...@hortonworks.com] On Behalf Of
> Gopal Vijayaraghavan
> Sent: Tuesday, October 22, 2013 9:03 AM
> To: common-dev@hadoop.apache.org
> Subject: Re: Combiner Execution
>
> Hi,
>
>
...@hortonworks.com [mailto:go...@hortonworks.com] On Behalf Of
Gopal Vijayaraghavan
Sent: Tuesday, October 22, 2013 9:03 AM
To: common-dev@hadoop.apache.org
Subject: Re: Combiner Execution
Hi,
I'll answer your questions in reverse.
> According to http://developer.yahoo.com/hadoop/tutorial
Hi,
I'll answer your questions in reverse.
> According to http://developer.yahoo.com/hadoop/tutorial/module4.html the
> output is already combined over all Mappers in a node. But we can not find
> how this is happening. Can someone point us to where this combiner is
> executed?
You'll find th
What sort of combining are you trying to achieve?
Hadoop combining means that hadoop will collect the output from all the
maps and guarantee that all the outputs that have the same key will be sent
to the same reducer (you can find more details in "hadoop the definitive
guide chapters 2 and 6).
For a class project my group and I are looking to experiment with
combining the output from Mappers on the same node or in the same rack.
We found the idea at http://wiki.apache.org/hadoop/HadoopResearchProjects.
According to http://developer.yahoo.com/hadoop/tutorial/module4.html the
output i
