Re: Is Hive Index officially not recommended?

2016-02-08 Thread Gopal Vijayaraghavan
> Is anybody storing there index in a non-native table such as HBase? ... > Can you please point to implementations of HiveIndexHandler or >AbstractIndexHandler > that have usesIndexTable=false I don't think there are any publically available implementations yet. The Hive HBase-metastore project

Set Split Size on a Table Basis

2016-02-08 Thread Wenlei Xie
Hi, I have the following format query running through Hive. The UDF is slow and is the bottleneck for the query. Select X FROM A WHERE Y!=0 and SlowUDF(Z) UNION ALL SELECT X FROM B WHERE SlowUDF(Z) Table A is 10x larger than table B, however, only a 1% of tuples in Table A satisfies Y!=0, thus t

Re: Hive Permanent functions not working after a cluster restart.

2016-02-08 Thread Jason Dere
Ok, not familiar with that version, might need to check with the cloudera folks. Are you able to try using Apache Hive 1.1.0? From: Chagarlamudi, Prasanth Sent: Monday, February 08, 2016 1:57 PM To: user@hive.apache.org Subject: RE: Hive Permanent functions not

Vectorized Query Execution in Hive

2016-02-08 Thread Mich Talebzadeh
Hi, Vectorized Query Execution works on ORC files and is supposed to reduce the CPU usage and generally improves the performance of jobs. You can turn it on by using set hive.vectorized.execution.enabled=tru

Re: "PermGen space" error

2016-02-08 Thread Stephen Bly
You can play around with these settings: http://stackoverflow.com/questions/8356416/xxmaxpermsize-with-or-without-xxpermsize We ran into the same problem at my last company. Turns out it had to do with the way Hive Server was loading jars, IIRC it was because Hive was loading the same class defini

RE: Hive Permanent functions not working after a cluster restart.

2016-02-08 Thread Chagarlamudi, Prasanth
It's a GenericUDF function. It just return current timestamp. However I found one thing different from the HIVE-10288, the permanent function works fine even after I exit the cli and try calling the function from a new cli. It only return the att

Re: Hive Permanent functions not working after a cluster restart.

2016-02-08 Thread Jason Dere
Based on the stack trace, it looks like the function registry had an entry for the function name, but a reference in this entry was null. What kind of function is it - is it a normal function (UDF/GenericUDF), or a UDTF (table function), or a UDAF (aggregation function)? Stack trace looks simi

RE: Hive Permanent functions not working after a cluster restart.

2016-02-08 Thread Chagarlamudi, Prasanth
Hey Jason, Its 1.1.0. Thank you for your time. Prasanth Chagarlamudi From: Jason Dere [mailto:jd...@hortonworks.com] Sent: Monday, February 08, 2016 1:04 PM To: user@hive.apache.org Subject: Re: Hive Permanent functions not working after a cluster restart. What version of Hive? _

Re: "PermGen space" error

2016-02-08 Thread mahender bigdata
Any update on this error. has anyone faced this issue On 2/7/2016 1:53 PM, mahender bigdata wrote: Hi Team, We are continuously getting *"PermGen space" *error. We have increased Mapper and its Heap size also. but no luck. we are using hive 1.2. When i search in google, it has been said th

Re: Hive Permanent functions not working after a cluster restart.

2016-02-08 Thread Jason Dere
What version of Hive? From: Chagarlamudi, Prasanth Sent: Monday, February 08, 2016 7:38 AM To: user@hive.apache.org Subject: Hive Permanent functions not working after a cluster restart. I created permanent functions(rather than temp functions) in Hive to use it

Hive Permanent functions not working after a cluster restart.

2016-02-08 Thread Chagarlamudi, Prasanth
I created permanent functions(rather than temp functions) in Hive to use it across different sessions. It all works fine until I actually restart the hive server or cluster for any reason. So is this the intended functionality of Permanent functions? Here is the hive doc link for Permanent func