open issue
https://issues.apache.org/jira/browse/HADOOP-5539
Billy
"Billy Pearson" <billy_pear...@sbcglobal.net>
wrote in message news:cecf0598d9ca40a08e777568361de...@billypc...
How are you concluding that the intermediate output is compressed from
the map, but not in the reduce? -C
my hadoop-site.xml
<property>
<name>mapred.compress.map.output</name>
<value>true</value>
<description>Should the job outputs be compressed?
</description>
</property>
<property>
<name>mapred.output.compression.type</name>
<value>BLOCK</value>
<description>If the job outputs are to compressed as SequenceFiles, how
should
they be compressed? Should be one of NONE, RECORD or BLOCK.
</description>
</property>
from the job.xml
mapred.output.compress = false // final output
mapred.compress.map.output = true // map output
+ I can head the files from comand line and read the key / value in the
reduce intermediate merges but not the map.out files.
