Re: Gzip progress during map phase.

2011-12-27 Thread Niels Basjes
Yes, this is what i was looking for. Thanks -- Met vriendelijke groet, Niels Basjes (Verstuurd vanaf mobiel ) Op 27 dec. 2011 12:08 schreef "Koji Noguchi" het volgende: > Assuming you're using TextInputFormat, it sounds like > https://issues.apache.org/jira/browse/MAPREDUCE-773 > In 0.21. Don'

Re: Gzip progress during map phase.

2011-12-27 Thread Koji Noguchi
Assuming you're using TextInputFormat, it sounds like https://issues.apache.org/jira/browse/MAPREDUCE-773 In 0.21. Don't know about CDH. Koji On 12/27/11 2:00 AM, "Niels Basjes" wrote: > I would not expect this. I would expect behaviour that is independent of > the way the splits are created.

Re: Gzip progress during map phase.

2011-12-27 Thread Niels Basjes
I would not expect this. I would expect behaviour that is independent of the way the splits are created. -- Met vriendelijke groet, Niels Basjes (Verstuurd vanaf mobiel ) Op 26 dec. 2011 07:57 schreef "Anthony Urso" het volgende: > Gzip files (unlike uncompressed files) are not splittable, whic

Re: Gzip progress during map phase.

2011-12-25 Thread Anthony Urso
Gzip files (unlike uncompressed files) are not splittable, which may be causing the behavior that you described. On Dec 24, 2011 6:24 AM, "Niels Basjes" wrote: > Hi, > > I noticed that the mapper progress indication in the hadoop cdh3 > distribution jumps from 0% to 100% for each gzipped input fi