Re: Where does the compression take place for MapOutputStream in Map phase?

2011-07-05 Thread Harsh Chouraria
Hello Rui Hou, If you look at the Writer constructor used here, you'll get your answer very easily. It takes a codec (a compression codec, to be specific) as an argument. The codec, if not null (in case compression is disabled), is then responsible for compressing the streams of data by wrappin

Review Request: HADOOP-7328. Improve the SerializationFactory functions.

2011-06-11 Thread Harsh Chouraria
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/884/ --- Review request for hadoop-common and Todd Lipcon. Summary --- Since getSeria

Re: hadoop parameters config files location

2011-04-04 Thread Harsh Chouraria
Hello, On Tue, Apr 5, 2011 at 12:52 AM, bikash sharma wrote: > Hi, > I want to change the following hadoop parameters before launching TeraSort > program: > io.sort.factor > io.sort.mb > mapreduce.reduce.tasks > io.file.buffer.size > io.sort.record.percent Making these changes in the mapred-site