ArrayIndexOutOfBoundsException while writing MapReduce output as RCFile

2014-04-30 Thread John Zeng
That is exactly the fix. Thanks Yin.

Re: ArrayIndexOutOfBoundsException while writing MapReduce output as RCFile

2013-10-21 Thread Yin Huai
Seems you did not set the number of columns (RCFileOutputFormat.setColumnNumber(Configuration conf, int columnNum)). Can you set it in your main method and see if your MR program works? Thanks, Yin On Mon, Oct 21, 2013 at 2:38 PM, Krishnan K wrote: > Hi All, > > I have a scenario where I've t

ArrayIndexOutOfBoundsException while writing MapReduce output as RCFile

2013-10-21 Thread Krishnan K
Hi All, I have a scenario where I've to read an RCFile, process it and write the output as an RCFile using a MapReduce program. My Hadoop version is *CDH 4.2.1 * * * *Mapper* Map Input = LongWritable, BytesRefArrayWritable Map Output = Text, BytesRefArrayWritable (Record)