Re: RCFile in java MapReduce

2012-01-09 Thread Aniket Mokashi
A better way would be to mount a table on top of RCFiles and use http://incubator.apache.org/hcatalog/docs/r0.2.0/inputoutput.html#HCatInputFormat But, you will have to install and run hcatalog server for it. (Note: By default, hcatalog assumes underlying storage is RCFile, so you do not need to p

Re: RCFile in java MapReduce

2012-01-09 Thread Yin Huai
I have some experiences using RCFile with new MapReduce API from the project HCatalog ( http://incubator.apache.org/hcatalog/ ). For the output part, In your main, you need ... > job.setOutputFormatClass(RCFileMapReduceOutputFormat.class); > > RCFileMapReduceOutputFormat.setColumnNumber(job.getCo

RCFile in java MapReduce

2011-12-14 Thread Dominik Wiernicki
Hi, Can someone show me how to use RCfile in plain MapReduce job (as Input and Output Format)? Please.