Hi, We are running Hadoop jobs with mappers only, no reducers. After each map computation, it writes its result (i.e. intermediate results) to local disk. How fast is this speed, compared with write-speed to HDFS? We used TestFDSIO to do the benchmark to get write-speed to HDFS, but we wonder how much the gap is.
Another question is, when did Hadoop move this chuck to HDFS? Any thoughts, guys? Thanks ahead. Xun