Re: Which SerDe for Custom Binary Data.

2015-03-13 Thread karthik maddala
Currently we have data in NFS and we have proprietery tools to access the data. We are planning to move the data into HDFS and use HiveQL for accessing the data and run batch jobs. So looking out for the custom SerDe(assuming the existing SerDe's will not be able to read the underlying data) to re

Re: Which SerDe for Custom Binary Data.

2015-03-13 Thread Daniel Haviv
https://cwiki.apache.org/confluence/display/Hive/DeveloperGuide#DeveloperGuide-HowtoWriteYourOwnSerDe Daniel > On 13 במרץ 2015, at 17:56, karthik maddala wrote: > > > > I want to set up a DW based on Hive. However, my data does not come as handy > csv files but as binary files in a propr

RE: Which SerDe for Custom Binary Data.

2015-03-13 Thread Mich Talebzadeh
Hive as I use it is particularly useful for getting data out of relational tables and more importantly query that data using HiveQL (a variation of transact sql) . If your data is in binary format and assuming that you manage to store it in HDFS, how are you intending to access the data. At