Re: Writing Custom Serdes for Hive

2012-10-16 Thread John Omernik
gt; >> http://svn.apache.org/viewvc/hive/trunk/contrib/src/java/org/apache/hadoop/hive/contrib/serde2/RegexSerDe.java?revision=1131106&view=markup >> >> >> >> Also, nice article by Roberto Congiu… >> >> ** ** >> >> http://www.co

Re: Writing Custom Serdes for Hive

2012-10-16 Thread shrikanth shankar
ongiu.com/a-json-readwrite-serde-for-hive/ > > > > Chuck Connell > > Nuance R&D Data Team > > Burlington, MA > > > > > > From: John Omernik [mailto:j...@omernik.com] > Sent: Tuesday, October 16, 2012 11:30 AM > To: user@hive.apache.o

Re: Writing Custom Serdes for Hive

2012-10-16 Thread John Omernik
ngiu… > > ** ** > > http://www.congiu.com/a-json-readwrite-serde-for-hive/ > > ** ** > > Chuck Connell > > Nuance R&D Data Team > > Burlington, MA > > ** ** > > ** ** > > *From:* John Omernik [mailto:j...@omernik.com] > *Sent:* T

RE: Writing Custom Serdes for Hive

2012-10-16 Thread Connell, Chuck
mailto:j...@omernik.com] Sent: Tuesday, October 16, 2012 11:30 AM To: user@hive.apache.org Subject: Writing Custom Serdes for Hive We have a maybe obvious question about a serde. When a serde in invoked, does it have access to the original hive query? Ideally the original query could provide the Serde so

Re: Writing Custom Serdes for Hive

2012-10-16 Thread Ariel Marcus
John, This article is pretty good: http://www.congiu.com/a-json-readwrite-serde-for-hive/ It looks like you can get access to the information you are looking for in the Properties object passed to the SerDe's initialize method. public void initialize(Configuration conf, Properties tbl) throws S

Writing Custom Serdes for Hive

2012-10-16 Thread John Omernik
We have a maybe obvious question about a serde. When a serde in invoked, does it have access to the original hive query? Ideally the original query could provide the Serde some hints on how to access the data on the backend. Also, are there any good links/documention on how to write Serdes? Kind