Hello all,
I added the capacity to tolerate arbitrary faults in Hadoop 0.20 by
changing some Hadoop classes.
You can see my work in http://dl.acm.org/citation.cfm?id=2116190
Now, I would like to make the code publicly available.
Since the code is under "Licensed to the Apache Software Foundat
I am trying to implement a mechanism in MapReduce v2 that allows to suspend
and resume a job. I must suspend a job when all the mappers finish, and
resume the job from that point after some time. I do this, because I want
to verify the integrity of the map output before executing the reducers.
I a
I am using Mapreduce v2.
On Aug 25, 2016 8:18 PM, "xeon Mailinglist"
wrote:
> I am trying to implement a mechanism in MapReduce v2 that allows to
> suspend and resume a job. I must suspend a job when all the mappers finish,
> and resume the job from that point after s
thing you can try is to write a map-only job first and then verify the
map out.
On Thu, Aug 25, 2016 at 1:18 PM, xeon Mailinglist wrote:
> I am using Mapreduce v2.
>
> On Aug 25, 2016 8:18 PM, "xeon Mailinglist"
> wrote:
>
> > I am trying to implement a mechanism in
7;s only partially
> dumped to disk. None of the intermediate data goes into HDFS.
>
> Daniel
>
> On Aug 25, 2016 4:10 PM, "xeon Mailinglist"
> wrote:
>
>> But then I need to set identity maps to run the reducers. If I suspend a
>> job after the maps finish,
