When I run sql in hive , the job hang by map task forever

2015-01-26 Thread r7raul1...@163.com
hive 0.13.1 tez0.4.1 hadoop 2.3.0 When I run sql in hive , the job hang by map task forever Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/1 Map 1: 0/

Re: convert empty strings to null

2015-01-26 Thread Devopam Mittra
You may simply try the below if it helps... CASE LENGTH(colname) WHEN 0 THEN NULL ELSE colname if needed , use substring to derive the 'colname' from your json tuple.. and apply / extend the same logic regards Dev On Mon, Jan 26, 2015 at 11:35 PM, Binal Jhaveri wrote: > My input file is a j

RE: Hive JSON Serde question

2015-01-26 Thread Martin, Nick
Hi Ari, Please send an email to user-unsubscr...@hive.apache.org Thanks! Nick From: Ari Flink [mailto:flinks...@gmail.com] Sent: Monday, January 26, 2015 1:30 PM To: user@hive.apache.org Subject: Re: Hive JSON Serde question unsubscribe On Sun, Jan 25,

Re: Hive JSON Serde question

2015-01-26 Thread Ari Flink
unsubscribe On Sun, Jan 25, 2015 at 6:54 PM, Sanjay Subramanian < sanjaysubraman...@yahoo.com> wrote: > sure will try get_json_object > thank u > regards > sanjay > > -- > *From:* 丁桂涛(桂花) > *To:* user@hive.apache.org; Sanjay Subramanian < > sanjaysubraman...@yahoo.

Re: Query rerun with global limitation

2015-01-26 Thread Gopal V
On 1/26/15, 9:18 AM, Philippe Kernévez wrote: This degradation is due to this bug (requests are replayed with a full scan) : https://issues.apache.org/jira/browse/HIVE-9382 I doubt that is the issue you are hitting, if you're moving from 0.13 to 0.14. You are possibly hitting HIVE-9401. To

convert empty strings to null

2015-01-26 Thread Binal Jhaveri
My input file is a json file. I am loading that into a staging table. Then i am parsing the json using hive (Lateral view and json_tuple) and writing to a final avro table. My issue is some json values have empty strings. I want those empty strings to display as null.. what is the best way to achie

Query rerun with global limitation

2015-01-26 Thread Philippe Kernévez
Hi, I just upgrade to hive 0.14 and I have a lot of requests that are now very slow. This degradation is due to this bug (requests are replayed with a full scan) : https://issues.apache.org/jira/browse/HIVE-9382 Do your know if there is a workaround for this bug ? I tried to change the value of

Orc file input format

2015-01-26 Thread patcharee
Hi, Is there any example to read/query orc file using orc file input format from Map-Reduce job or Spark job? BR, Patcharee