Re: NLine Input Format

2008-11-19 Thread Amareshwari Sriramadasu
Rahul Tenany wrote: Hi Amareshwari, It is in the ToolRunner.run() method that i am setting the FileInputFormat as NLineInputFormat and in the same function i am setting the mapred.line.input.format.linespermap property. Will that not work? How can i overload LineRecordReader, so that it re

Re: NLine Input Format

2008-11-19 Thread Amareshwari Sriramadasu
Rahul Tenany wrote: Hi Amareshwari, It is in the ToolRunner.run() method that i am setting the FileInputFormat as NLineInputFormat and in the same function i am setting the mapred.line.input.format.linespermap property. Will that not work? How can i overload LineRecordReader, so that it re

Re: NLine Input Format

2008-11-19 Thread Rahul Tenany
Hi Amareshwari,It is in the ToolRunner.run() method that i am setting the FileInputFormat as NLineInputFormat and in the same function i am setting the mapred.line.input.format.linespermap property. Will that not work? How can i overload LineRecordReader, so that it returns the value as N Lines

Re: NLine Input Format

2008-11-16 Thread Amareshwari Sriramadasu
Hi Rahul, How did you set the configuration "mapred.line.input.format.linespermap" and your input format? You have to set them in hadoop-site.xml or pass them through -D option to the job. NLineInputFormat will split N lines of input as one split. So, each map gets N lines. But the RecordReade