Re: handling null argument in custom udf

2012-12-04 Thread Mark Grover
Soren, Can you give the complete stack trace? Or share the code? Perhaps, the skeletal code. Look at Ceil UDF for example, it has a null check, you should be able to do something similar: https://github.com/apache/hive/blob/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFCeil.java#L43 I would e

Re: Problems Sqoop importing columns with NULLs

2012-12-04 Thread Krishna Rao
Thanks Jarek. Good to hear it's at least a known issue. On 4 December 2012 17:20, Jarek Jarcec Cecho wrote: > Hi Krishna, > I'm afraid that this is known limitation of current PostgreSQL direct > connector. We already have a JIRA to address this - SQOOP-654 [1]. > > Currently suggested workaroun

Problems Sqoop importing columns with NULLs

2012-12-04 Thread Krishna Rao
Hi all, I'm haivng trouble transfering NULLs in a VARCHAR column in a table in PostgresQL into Hive. A null value ends up as an empty value in Hive, rather than NULL. I'm running the following command: sqoop import --username -P --hive-import --hive-overwrite --null-string='\\N' --null-non-stri

Re: CREATE DATABASE WITH LOCATION

2012-12-04 Thread abhishek
Thanks Thiruvel Sent from my iPhone On Dec 4, 2012, at 10:09 AM, Thiruvel Thirumoolan wrote: > This feature (HIVE-1537) was added in Hive 0.8. > > On 12/4/12 7:37 PM, "abhishek" wrote: > >> hi all, >> >> I am trying the below query >> >> Create database >> Location '/my/preferred/di

Re: CREATE DATABASE WITH LOCATION

2012-12-04 Thread Thiruvel Thirumoolan
This feature (HIVE-1537) was added in Hive 0.8. On 12/4/12 7:37 PM, "abhishek" wrote: >hi all, > >I am trying the below query > >Create database >Location '/my/preferred/directory' > >But getting the below error > >FAILED: Parse Error : line 2:0 mismatched input 'LOCATION' excepting EOF >ne

Re: handling null argument in custom udf

2012-12-04 Thread Søren
Thanks. Did you mean I should handle null in my udf or my serde? I did try to check for null inside the code in my udf, but it fails even before it gets called. This is from when the udf fails: Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to execute method public o

Re: handling null argument in custom udf

2012-12-04 Thread Edward Capriolo
There is no null argument. You should handle the null case in your code. If (arga == null) Or optionally you could use a generic udf but a regular one should handle what you are doing. On Tuesday, December 4, 2012, Søren wrote: > Hi Hive community > > I have a custom udf, say myfun, written in

Re: Hive 0.7 use the old mapred API

2012-12-04 Thread Edward Capriolo
this is an unfortunate issue with hive we only support mapred api not mapreduce. If you look at the hbase and cassandra support you see that sonetimes you can wrap a mapreduce input format by extending the new interface and implementing the old one. So it is possible to use a newer api but its ugly

CREATE DATABASE WITH LOCATION

2012-12-04 Thread abhishek
hi all, I am trying the below query Create database Location '/my/preferred/directory' But getting the below error FAILED: Parse Error : line 2:0 mismatched input 'LOCATION' excepting EOF near '' I am using hive 0.7 Regards Abhi

handling null argument in custom udf

2012-12-04 Thread Søren
Hi Hive community I have a custom udf, say myfun, written in Java which I utilize like this select myfun(col_a, col_b) from mytable where etc col_b is a string type and sometimes it is null. When that happens, my query crashes with --- java.lang.RuntimeException: org.apache.ha