Re: Convert data to BytesRefArrayWritable

2010-11-13 Thread yongqiang he
If your old data are stored in Hive, you can just use "insert overwrite" to convert the data. If you want your data be directly generated to a RCFile, rcfile has its own Writer API. You can find some examples from TestRCFile testcase from Hive.. On Sat, Nov 13, 2010 at 2:30 PM, Avrilia Floratou

Convert data to BytesRefArrayWritable

2010-11-13 Thread Avrilia Floratou
Hi, I want to convert data stored in a hadoop sequence file to BytesRefArrayWritable so that I can use RCFileOutputFormat and create an RCFile. My data contains integers,strings and hashmaps. I guess I don't have to write my own serializer/deserializer for these. I tried using the ColumnarS