Re: Hive statistics

2016-12-21 Thread Haas, Nichole
Hi Rob, I am not a developer, but I can tell you that to generate such statistics, we had an intern work in spark all last summer. So, I don’t think it is built into hive. Hope this helps you, ~Nikki From: Robert Grandl Reply-To: "user@hive.apache.org" , Robert Grandl Date: Wednesday, Decemb

Re: Extracting data from ELB log date format

2016-09-21 Thread Haas, Nichole
in Hive CL: set today = cast(concat(substr(cast(current_date() as string),1,4),substr(cast(current_date() as string),6,2),substr(cast(current_date() as string),9,2)) as int) From: Manish Rangari Reply-To: "user@hive.apache.org" Date: Wednesday, September 21, 2016 at 6:23 AM To: "user@hive.apa

Re: Query fails if condition placed on Parquet struct field

2016-05-03 Thread Haas, Nichole
What are you memory allocations set to? When using something as expensive as LIKE and a date range together, I often have to increase my standard memory allocation. Try changing your memory allocation settings to: Key: ​mapreduce.map.memory.mb​ Value: ​2048​ and Key: ​mapreduce.map.java.opts​