i do an INSERT/SELECT into the "jsonTable" (create table attached)
with no problems. This table use a json Serde
(org.openx.data.jsonserde.JsonSerDe)
and a ORC format and is also particioned by date and timezone.
The problem is that after all this process every time a try to make a
simp
the serde config when
creating the table.
This functionality is provided by this SerDe (https://github.com/rcongiu/
Hive-JSON-Serde), and trying to get something similar.
Thanks.
--
Jagrut
Hi Udit
3 years ago I extended the hive-JSON-serde to support maps and arrays. I think
I am the only user of this code, ☺
It still work for me today with hive 13
You can find my code here:
https://github.com/guydou/hive-json-serde
Using this serde you can declare a unique field also called
uot;search",
"context": "test",
"extra_info": null
}
},
"sourceType": "test_source",
"millisecond": null,
"sourceFile": "test_file"
}
I am currently using the json serde :
h
Hi Ari,
Please send an email to
user-unsubscr...@hive.apache.org<mailto:user-unsubscr...@hive.apache.org>
Thanks!
Nick
From: Ari Flink [mailto:flinks...@gmail.com]
Sent: Monday, January 26, 2015 1:30 PM
To: user@hive.apache.org
Subject: Re: Hive JSON Serde question
unsubscribe
On Sun,
Subramanian <
> sanjaysubraman...@yahoo.com>
> *Sent:* Sunday, January 25, 2015 4:45 PM
> *Subject:* Re: Hive JSON Serde question
>
> Try get_json_object UDF. No iterations need. :)
>
>
>
> On Mon, Jan 26, 2015 at 12:25 AM, Sanjay Subramanian <
> sanjaysubraman...@yahoo
sure will try get_json_objectthank uregardssanjay
From: 丁桂涛(桂花)
To: user@hive.apache.org; Sanjay Subramanian
Sent: Sunday, January 25, 2015 4:45 PM
Subject: Re: Hive JSON Serde question
Try get_json_object UDF. No iterations need. :)
On Mon, Jan 26, 2015 at 12:25 AM, Sanjay
--
> *From:* Edward Capriolo
> *To:* "user@hive.apache.org" ; Sanjay Subramanian <
> sanjaysubraman...@yahoo.com>
> *Sent:* Sunday, January 25, 2015 8:11 AM
> *Subject:* Re: Hive JSON Serde question
>
> Nested lists require nested lateral vie
Thanks Ed. Let me try a few more iterations. Somehow I am not doing this
correctly :-)
regards
sanjay From: Edward Capriolo
To: "user@hive.apache.org" ; Sanjay Subramanian
Sent: Sunday, January 25, 2015 8:11 AM
Subject: Re: Hive JSON Serde question
Nested lists requ
Nested lists require nested lateral views.
On Sun, Jan 25, 2015 at 11:02 AM, Sanjay Subramanian <
sanjaysubraman...@yahoo.com> wrote:
> hey guys
>
> This is the Hive table definition I have created based on the JSON
> I am using this version of hive json serde
> https://gi
hey guys
This is the Hive table definition I have created based on the JSON I am using
this version of hive json serde https://github.com/rcongiu/Hive-JSON-Serde
ADD JAR
/home/sanjay/mycode/jar/jsonserde/json-serde-1.3.1-SNAPSHOT-jar-with-dependencies.jar;DROP
TABLE IF EXISTS datafeed_json
day, September 17, 2012 7:31 PM
>
> *To:* Connell, Chuck
> *Cc:* user@hive.apache.org
> *Subject:* Re: hive json serde
>
> ** **
>
> Thanks Chuck.
>
> I tried both json_tuple & get_json_objects on top of the serde table and
> it works too. I have nested jsons a
nell, Chuck
Cc: user@hive.apache.org
Subject: Re: hive json serde
Thanks Chuck.
I tried both json_tuple & get_json_objects on top of the serde table and it
works too. I have nested jsons and some of the keys do not have a specific
schema (You can throw whatever you want there) so if I want
ot;$.D") ilike "chuck"
I like serde table because it is much cleaner than create a table with
(value string) and then doing get_json_object or json_tuple and extract all
the columns out.
I'm exposing this table to other users in my company so I want to have the
serde tab
A few things that should help...
- There are three ways to handle JSON within a Hive table, get_json_object,
json_tuple, and JSON SerDe. These are separate mechanisms. So if you want to
use get_json_object, you don't need to load a SerDe.
- With a SerDe, Hive understands JSON fields nat
--
>> *From:* Mark Golden [mark.golden1...@gmail.com]
>> *Sent:* Monday, September 17, 2012 5:32 PM
>> *To:* Connell, Chuck
>> *Subject:* Re: hive json serde
>>
>> Hey Chuck,
>>
>> Where did you download the prebuild jar from?
>>
>&
; *
>
> ** **
>
> Chuck
>
> ** **
>
> ** **
>
> ** **
>
> *From:* Connell, Chuck [mailto:chuck.conn...@nuance.com]
> *Sent:* Monday, September 17, 2012 3:06 PM
> *To:* user@hive.apache.org
> *Subject:* RE: hive json serde
>
> ** **
>
> I just finished testing this o
I used his pre-built jar. No need to compile anything.
Be sure to add " --auxpath /path/to/jar/dir " to the Hive command line.
Chuck
From: Connell, Chuck [mailto:chuck.conn...@nuance.com]
Sent: Monday, September 17, 2012 3:06 PM
To: user@hive.apache.org
Subject: RE: hive json ser
I just finished testing this one. No problems found. The developer is also
quite responsive to issues raised. I encouraged him to submit it to the Hive
dev team as core code.
https://github.com/rcongiu/Hive-JSON-Serde/
Chuck Connell
Nuance R&D Data Team
Burlington, MA
From: Mark Go
Hi,
I'm looking for a hive json serde that works well. Any suggestions? I did a
quick google and found a few but none of them are complete.
Thanks,
Mark.
Hello,
If I have posted this question in the wrong mailing list, kindly suggest
the right one because I have just joined the group.
My JSON is in the following format:
{"ProfileId":111,"CustomerId":111,"UserId":222,"DateString":"2011-01-01
14:24:52","Machine":"MyMachine","AppName":"TTT","
Hey guys,
I wrote a JSON SerDe for Hive. There's one around but I found out it's read
only.
This one supports both serializing and deserializing, supports Hive array<>
and map<> that could also be nested.
Code is on github: https://github.com/rcongiu/Hive-JSON-Serde
My em
22 matches
Mail list logo