Re: Hive to read sequencefile

2012-07-09 Thread Edward Capriolo
yes you need an input format. I have one that turns key plus value to a pairwritable On Monday, July 9, 2012, Daning Wang wrote: > Thanks Navis. > > The problem is that the key and value are custom classes. e.g, key is class A, and value is class B. we want to show certain data in Class A and B f

Re: Hive to read sequencefile

2012-07-09 Thread Daning Wang
Thanks Navis. The problem is that the key and value are custom classes. e.g, key is class A, and value is class B. we want to show certain data in Class A and B from getters. so we do need a SerDe to deserialize the data. Since SerDe interface can only pass one parameter, so I need to write a Inp

Re: Hive to read sequencefile

2012-07-09 Thread Navis류승우
You can try 'STORED AS SEQUENCEFILE' when creating table. https://cwiki.apache.org/Hive/languagemanual-ddl.html#LanguageManualDDL-Create%252FDropTable 2012/7/10 Daning Wang > Hi all, > > New to here. I have sequence files and I want to read in Hive, I did some > search on the net. looks the w

Hive to read sequencefile

2012-07-09 Thread Daning Wang
Hi all, New to here. I have sequence files and I want to read in Hive, I did some search on the net. looks the way I need to do 1. Write new FileInputFormat so Hive can read both key and value. (ref http://osdir.com/ml/hive-user-hadoop-apache/2009-10/msg00034.html) 2. Write a SerDe to deseriali