Re: How to load json data with nested arrays into hive?

2014-06-20 Thread Douglas Moore
Hi Chris, Try this Serde , I looked at 6 of them a while back and this one was the best, including dealing with nested JSON structures: https://github.com/rcongiu/Hive-JSON-Serde - Douglas

Re: hive cli configuration quesiton

2014-06-16 Thread Douglas Moore
Glad to help.

Re: hive cli configuration quesiton

2014-06-16 Thread Douglas Moore
Hive CLI has a -i option. We create a pre.sql file with hive settings and then specify: hive -i pre.hql -f query.hql On Mon, Jun 16, 2014 at 2:52 PM, Jinyuan Zhou wrote: > Hi, > I like to include common settings in one place when I run different hql > script via hive cli. > My setting is reall

Re: Hive 0.13 - Yarn - Tez application not shutting down

2014-06-12 Thread Douglas Moore
set hive.exec.parallel=true; will cause the Yarn application to linger forever. Set hive.exec.parallel=false and the Yarn application disappears after running the Hive CLI finishes. Is this a Hive, Yarn or Tez bug? On Thu, Jun 12, 2014 at 4:15 PM, Douglas Moore < douglas

Hive 0.13 - Yarn - Tez application not shutting down

2014-06-12 Thread Douglas Moore
I'm on HDP 2.1 Hive 0.13/Tez I run this query: hive -v --database=ORC_db -e `select * from store_sales where ss_ticket_number=5741230 and ss_item_sk=4825` The yarn application runs Tez for a few seconds, generates the results and shuts down and goes away as reported by `yarn application -list`.