Re: NLine Input Format

2008-11-19 Thread Amareshwari Sriramadasu
Rahul Tenany wrote: Hi Amareshwari, It is in the ToolRunner.run() method that i am setting the FileInputFormat as NLineInputFormat and in the same function i am setting the mapred.line.input.format.linespermap property. Will that not work? How can i overload LineRecordReader, so that it re

Re: NLine Input Format

2008-11-19 Thread Amareshwari Sriramadasu
Rahul Tenany wrote: Hi Amareshwari, It is in the ToolRunner.run() method that i am setting the FileInputFormat as NLineInputFormat and in the same function i am setting the mapred.line.input.format.linespermap property. Will that not work? How can i overload LineRecordReader, so that it re

Re: NLine Input Format

2008-11-19 Thread Rahul Tenany
Hi Amareshwari,It is in the ToolRunner.run() method that i am setting the FileInputFormat as NLineInputFormat and in the same function i am setting the mapred.line.input.format.linespermap property. Will that not work? How can i overload LineRecordReader, so that it returns the value as N Lines

Re: NLine Input Format

2008-11-16 Thread Amareshwari Sriramadasu
Hi Rahul, How did you set the configuration "mapred.line.input.format.linespermap" and your input format? You have to set them in hadoop-site.xml or pass them through -D option to the job. NLineInputFormat will split N lines of input as one split. So, each map gets N lines. But the RecordReade

NLine Input Format

2008-11-15 Thread Rahul Tenany
Hi, I am writing a Binary Search Tree on Hadoop and for the same i require to use NLineInputFormat. I'll read n lines at a time, convert the numbers in each line from string to int and then insert them into the binary tree. Once the binary tree is made i'll search for elements in it. But even if