RE: Hive JSON Serde question

2015-01-26 Thread Martin, Nick
Hi Ari, Please send an email to user-unsubscr...@hive.apache.org<mailto:user-unsubscr...@hive.apache.org> Thanks! Nick From: Ari Flink [mailto:flinks...@gmail.com] Sent: Monday, January 26, 2015 1:30 PM To: user@hive.apache.org Subject: Re: Hive JSON Serde question unsubscribe On Sun,

Re: Hive JSON Serde question

2015-01-26 Thread Ari Flink
Subramanian < > sanjaysubraman...@yahoo.com> > *Sent:* Sunday, January 25, 2015 4:45 PM > *Subject:* Re: Hive JSON Serde question > > Try get_json_object UDF. No iterations need. :) > > > > On Mon, Jan 26, 2015 at 12:25 AM, Sanjay Subramanian < > sanjaysubraman...@yahoo

Re: Hive JSON Serde question

2015-01-25 Thread Sanjay Subramanian
sure will try get_json_objectthank uregardssanjay   From: 丁桂涛(桂花) To: user@hive.apache.org; Sanjay Subramanian Sent: Sunday, January 25, 2015 4:45 PM Subject: Re: Hive JSON Serde question Try get_json_object UDF. No iterations need. :) On Mon, Jan 26, 2015 at 12:25 AM, Sanjay

Re: Hive JSON Serde question

2015-01-25 Thread 丁桂涛(桂花)
-- > *From:* Edward Capriolo > *To:* "user@hive.apache.org" ; Sanjay Subramanian < > sanjaysubraman...@yahoo.com> > *Sent:* Sunday, January 25, 2015 8:11 AM > *Subject:* Re: Hive JSON Serde question > > Nested lists require nested lateral vie

Re: Hive JSON Serde question

2015-01-25 Thread Sanjay Subramanian
Thanks Ed. Let me try a few more iterations. Somehow I am not doing this correctly :-)  regards sanjay From: Edward Capriolo To: "user@hive.apache.org" ; Sanjay Subramanian Sent: Sunday, January 25, 2015 8:11 AM Subject: Re: Hive JSON Serde question Nested lists requ

Re: Hive JSON Serde question

2015-01-25 Thread Edward Capriolo
Nested lists require nested lateral views. On Sun, Jan 25, 2015 at 11:02 AM, Sanjay Subramanian < sanjaysubraman...@yahoo.com> wrote: > hey guys > > This is the Hive table definition I have created based on the JSON > I am using this version of hive json serde > https://github.com/rcongiu/Hive-JS

Hive JSON Serde question

2015-01-25 Thread Sanjay Subramanian
hey guys  This is the Hive table definition I have created based on the JSON I am using this version of hive json serde https://github.com/rcongiu/Hive-JSON-Serde ADD JAR /home/sanjay/mycode/jar/jsonserde/json-serde-1.3.1-SNAPSHOT-jar-with-dependencies.jar;DROP TABLE IF EXISTS  datafeed_json;C

Re: SerDe question

2011-09-27 Thread Mark Kerzner
Thank you, Vijay. I was beginning to understand things that way myself, and you made it perfectly clear. Sincerely, Mark On Tue, Sep 27, 2011 at 11:18 PM, Vijay wrote: > There are a couple of problems. First of all, input.regex needs to be > "(\\w+)". Please note the case. > The bigger problem

Re: SerDe question

2011-09-27 Thread Vijay
There are a couple of problems. First of all, input.regex needs to be "(\\w+)". Please note the case. The bigger problem though, is that, with this (and most) serdes, you can only expect one row per line of input. So multiple words within the text cannot generate multiple rows. The best option is t

SerDe question

2011-09-27 Thread Mark Kerzner
Hi, Hive experts, Would you see what I am doing wrong? For a simple test of breaking a text into words and putting these words into a table, I am doing this CREATE EXTERNAL TABLE books1 ( words string ) ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.RegexSerDe' WITH SERDEPROPERTIES ("i

Re: Custom SerDe Question

2011-01-28 Thread phil young
.@gmail.com] > *Sent:* Friday, January 28, 2011 1:54 PM > *To:* user@hive.apache.org > *Subject:* Re: Custom SerDe Question > > > > To be clear, you would then create the table with the clause: > > > > STORED AS > > INPUTFORMAT 'your.custom.input.format

RE: Custom SerDe Question

2011-01-28 Thread Christopher, Pat
lls.yo...@gmail.com] Sent: Friday, January 28, 2011 1:54 PM To: user@hive.apache.org Subject: Re: Custom SerDe Question To be clear, you would then create the table with the clause: STORED AS INPUTFORMAT 'your.custom.input.format' If you make an external table, you'll then be able

Re: Custom SerDe Question

2011-01-28 Thread phil young
To be clear, you would then create the table with the clause: STORED AS INPUTFORMAT 'your.custom.input.format' If you make an external table, you'll then be able to point to a directory (or file) that contains gzipped files, or uncompressed files. On Fri, Jan 28, 2011 at 4:52 PM, phil young

Re: Custom SerDe Question

2011-01-28 Thread phil young
This can be accomplished with a custom input format. Here's a snippet of the relevant code in the customer RecordReader compressionCodecs = new CompressionCodecFactory(jobConf); Path file = split.getPath(); final CompressionCodec codec = compressionCodecs.

Custom SerDe Question

2011-01-28 Thread Christopher, Pat
Hi, I've written a SerDe and I'd like it to be able handle compressed data (gzip). Hadoop detects and decompresses on the fly so if you have a compressed data set and you don't need to perform any custom interpretation of it as you go, hadoop and hive will handle it. Is there a way to get Hive