RE: Clear up Hive scratch directory

Hi All, I just wanted to feedback that it does appear to be safe - I emptied the directory manually, without adverse consequences. Thanks, Martin. From: Martin Benson Sent: ‎20/‎04/‎2015 18:06 To: user@hive.apache.org

re: Create function using custom UDF

Referring to https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-Create/DropFunction You don’t need to add jar every time when using Permanent Functions. Make sure to create your function following this CREATE FUNCTION [db_name.]function_name AS class_name [USI

Re: Create function using custom UDF

Thanks again for the info! On Thu, Apr 23, 2015 at 8:30 PM, sadhana yr wrote: > For global configuration add the statements to $HIVE_HOME/bin/.hiverc. > > One other alternative, > > Add following property to your hive-site.xml > > > hive.aux.jars.path > > file:///home/me/my.jar,file:///home/you

Re: Create function using custom UDF

For global configuration add the statements to $HIVE_HOME/bin/.hiverc. One other alternative, Add following property to your hive-site.xml hive.aux.jars.path file:///home/me/my.jar,file:///home/you/your.jar,file:///home/us/our.jar On Thu, Apr 23, 2015 at 11:13 PM, Buntu Dev wrote: > Than

Re: Create function using custom UDF

Thanks but is there a way to make it available to other users and avoid 'add jar ' step? On Thu, Apr 23, 2015 at 7:50 PM, Sadhana wrote: > Yes, functions declared will only be available in the current session. You > will have to add the JAR to the class path and create the function in each > ses

Re: Create function using custom UDF

Yes, functions declared will only be available in the current session. You will have to add the JAR to the class path and create the function in each session. If you use the same Jar files and functions frequently, you can add those statements to your $HOME/.hiverc file. > On Apr 23, 2015, at

Create function using custom UDF

Does the JAR need to be added for every session before using the custom UDF created using "CREATE FUNCTION"? I'm using Hive 0.13 and was able to add a custom UDF successfully and use it in a sample query. But in the subsequent Hive sessions, I do see the function but I get this error when using th

Re: org.apache.hadoop.hive.ql.lockmgr.LockException: No record of lock could be found, may have timed out

Hi, I am using Zookeeper Thanks Let your email find you with BlackBerry from Vodafone -Original Message- From: Alan Gates Date: Thu, 23 Apr 2015 08:48:01 To: Reply-To: user@hive.apache.org Subject: Re: org.apache.hadoop.hive.ql.lockmgr.LockException: No record of lock could be found,

Fwd: java.lang.NullPointerException when using INSERT INTO ORC table with ACID property

Hi , We have a scenario to update a table from different set of tables for which we are using hive 0.14.Here are the steps that we are following 1.Parent table is ORC table with ACID property. 2.Delta table has updated records that need to be inserted to parent table(Delta table is also an ORC wi

Re: Parsing and moving data to ORC from HDFS

Hello. thank you for your information and tips. I will try a UDF with inspiration from get_json_object(). Thanks, Kjell Tore 22. apr. 2015 22:00 skrev "Gopal Vijayaraghavan" : > > > In production we run HDP 2.2.4. Any thought when crazy stuff like bloom > >filters might move to GA? > > I¹d say

Re: org.apache.hadoop.hive.ql.lockmgr.LockException: No record of lock could be found, may have timed out

What lock or transaction manager are you using? Alan. Mich Talebzadeh April 23, 2015 at 8:19 Hi all, Trying to do a direct load from RDBMS to Hive (not using Sqoop). It sends data in files of rows at a time. Concurrency is enabled. Using Oracle database as

org.apache.hadoop.hive.ql.lockmgr.LockException: No record of lock could be found, may have timed out

Hi all, Trying to do a direct load from RDBMS to Hive (not using Sqoop). It sends data in files of rows at a time. Concurrency is enabled. Using Oracle database as metastore. Out of 300,000 rows managed to get in 227,106 rows hive> select count(1) from t; Total MapReduce CP

Hive - how to skip empty inner fields

Hi, I have got complex schema with thousands of inner fields. Most of fields are empty and i would like to display only nonnull fields in results for each query. Is it possible to modify way the results are postprocessed ? Thank you Lukas

Hive - how to skip empty inner fields

Hi, I have got complex schema with thousands of inner fields. Most of fields are empty and i would like to display only nonnull fields in results for each query. Is it possible to modify way the results are postprocessed ? Thank you Lukas