Hive - Json Serde - ORC

2017-12-07 Thread kaducangica .
i do an INSERT/SELECT into the "jsonTable" (create table attached) with no problems. This table use a json Serde (org.openx.data.jsonserde.JsonSerDe) and a ORC format and is also particioned by date and timezone. The problem is that after all this process every time a try to make a simp

JSON SerDe column name mapping

2017-08-15 Thread Jagrut Sharma
the serde config when creating the table. This functionality is provided by this SerDe (https://github.com/rcongiu/ Hive-JSON-Serde), and trying to get something similar. Thanks. -- Jagrut

RE: Hive Json Serde

2015-02-23 Thread Guy Doulberg
Hi Udit 3 years ago I extended the hive-JSON-serde to support maps and arrays. I think I am the only user of this code, ☺ It still work for me today with hive 13 You can find my code here: https://github.com/guydou/hive-json-serde Using this serde you can declare a unique field also called

Hive Json Serde

2015-02-23 Thread Udit Mehta
uot;search", "context": "test", "extra_info": null } }, "sourceType": "test_source", "millisecond": null, "sourceFile": "test_file" } I am currently using the json serde : h

RE: Hive JSON Serde question

2015-01-26 Thread Martin, Nick
Hi Ari, Please send an email to user-unsubscr...@hive.apache.org<mailto:user-unsubscr...@hive.apache.org> Thanks! Nick From: Ari Flink [mailto:flinks...@gmail.com] Sent: Monday, January 26, 2015 1:30 PM To: user@hive.apache.org Subject: Re: Hive JSON Serde question unsubscribe On Sun,

Re: Hive JSON Serde question

2015-01-26 Thread Ari Flink
Subramanian < > sanjaysubraman...@yahoo.com> > *Sent:* Sunday, January 25, 2015 4:45 PM > *Subject:* Re: Hive JSON Serde question > > Try get_json_object UDF. No iterations need. :) > > > > On Mon, Jan 26, 2015 at 12:25 AM, Sanjay Subramanian < > sanjaysubraman...@yahoo

Re: Hive JSON Serde question

2015-01-25 Thread Sanjay Subramanian
sure will try get_json_objectthank uregardssanjay   From: 丁桂涛(桂花) To: user@hive.apache.org; Sanjay Subramanian Sent: Sunday, January 25, 2015 4:45 PM Subject: Re: Hive JSON Serde question Try get_json_object UDF. No iterations need. :) On Mon, Jan 26, 2015 at 12:25 AM, Sanjay

Re: Hive JSON Serde question

2015-01-25 Thread 丁桂涛(桂花)
-- > *From:* Edward Capriolo > *To:* "user@hive.apache.org" ; Sanjay Subramanian < > sanjaysubraman...@yahoo.com> > *Sent:* Sunday, January 25, 2015 8:11 AM > *Subject:* Re: Hive JSON Serde question > > Nested lists require nested lateral vie

Re: Hive JSON Serde question

2015-01-25 Thread Sanjay Subramanian
Thanks Ed. Let me try a few more iterations. Somehow I am not doing this correctly :-)  regards sanjay From: Edward Capriolo To: "user@hive.apache.org" ; Sanjay Subramanian Sent: Sunday, January 25, 2015 8:11 AM Subject: Re: Hive JSON Serde question Nested lists requ

Re: Hive JSON Serde question

2015-01-25 Thread Edward Capriolo
Nested lists require nested lateral views. On Sun, Jan 25, 2015 at 11:02 AM, Sanjay Subramanian < sanjaysubraman...@yahoo.com> wrote: > hey guys > > This is the Hive table definition I have created based on the JSON > I am using this version of hive json serde > https://gi

Hive JSON Serde question

2015-01-25 Thread Sanjay Subramanian
hey guys  This is the Hive table definition I have created based on the JSON I am using this version of hive json serde https://github.com/rcongiu/Hive-JSON-Serde ADD JAR /home/sanjay/mycode/jar/jsonserde/json-serde-1.3.1-SNAPSHOT-jar-with-dependencies.jar;DROP TABLE IF EXISTS  datafeed_json

Re: hive json serde

2012-09-18 Thread Mark Golden
day, September 17, 2012 7:31 PM > > *To:* Connell, Chuck > *Cc:* user@hive.apache.org > *Subject:* Re: hive json serde > > ** ** > > Thanks Chuck. > > I tried both json_tuple & get_json_objects on top of the serde table and > it works too. I have nested jsons a

RE: hive json serde

2012-09-18 Thread Connell, Chuck
nell, Chuck Cc: user@hive.apache.org Subject: Re: hive json serde Thanks Chuck. I tried both json_tuple & get_json_objects on top of the serde table and it works too. I have nested jsons and some of the keys do not have a specific schema (You can throw whatever you want there) so if I want

Re: hive json serde

2012-09-17 Thread Mark Golden
ot;$.D") ilike "chuck" I like serde table because it is much cleaner than create a table with (value string) and then doing get_json_object or json_tuple and extract all the columns out. I'm exposing this table to other users in my company so I want to have the serde tab

RE: hive json serde

2012-09-17 Thread Connell, Chuck
A few things that should help... - There are three ways to handle JSON within a Hive table, get_json_object, json_tuple, and JSON SerDe. These are separate mechanisms. So if you want to use get_json_object, you don't need to load a SerDe. - With a SerDe, Hive understands JSON fields nat

Re: hive json serde

2012-09-17 Thread Mark Golden
-- >> *From:* Mark Golden [mark.golden1...@gmail.com] >> *Sent:* Monday, September 17, 2012 5:32 PM >> *To:* Connell, Chuck >> *Subject:* Re: hive json serde >> >> Hey Chuck, >> >> Where did you download the prebuild jar from? >> >&

Re: hive json serde

2012-09-17 Thread Mark Golden
; * > > ** ** > > Chuck > > ** ** > > ** ** > > ** ** > > *From:* Connell, Chuck [mailto:chuck.conn...@nuance.com] > *Sent:* Monday, September 17, 2012 3:06 PM > *To:* user@hive.apache.org > *Subject:* RE: hive json serde > > ** ** > > I just finished testing this o

RE: hive json serde

2012-09-17 Thread Connell, Chuck
I used his pre-built jar. No need to compile anything. Be sure to add " --auxpath /path/to/jar/dir " to the Hive command line. Chuck From: Connell, Chuck [mailto:chuck.conn...@nuance.com] Sent: Monday, September 17, 2012 3:06 PM To: user@hive.apache.org Subject: RE: hive json ser

RE: hive json serde

2012-09-17 Thread Connell, Chuck
I just finished testing this one. No problems found. The developer is also quite responsive to issues raised. I encouraged him to submit it to the Hive dev team as core code. https://github.com/rcongiu/Hive-JSON-Serde/ Chuck Connell Nuance R&D Data Team Burlington, MA From: Mark Go

hive json serde

2012-09-17 Thread Mark Golden
Hi, I'm looking for a hive json serde that works well. Any suggestions? I did a quick google and found a few but none of them are complete. Thanks, Mark.

Cannot load array of struct using json serde

2012-07-22 Thread Nac
Hello, If I have posted this question in the wrong mailing list, kindly suggest the right one because I have just joined the group. My JSON is in the following format: {"ProfileId":111,"CustomerId":111,"UserId":222,"DateString":"2011-01-01 14:24:52","Machine":"MyMachine","AppName":"TTT","

JSON SerDe

2011-07-12 Thread Roberto Congiu
Hey guys, I wrote a JSON SerDe for Hive. There's one around but I found out it's read only. This one supports both serializing and deserializing, supports Hive array<> and map<> that could also be nested. Code is on github: https://github.com/rcongiu/Hive-JSON-Serde My em