Re: GenericUDF

2016-02-03 Thread Jason Dere
Same flow - initialize() is called on the GenericUDF very soon after construction, by the same methods that created the UDF. Take a look at TypeCheckProcFactory or ExprNodeGenericFuncDesc From: Anirudh Paramshetti Sent: Tuesday, February 02, 2016 9:24 PM To

Re: GenericUDF

2016-02-02 Thread Anirudh Paramshetti
ilation > > - The query plan is serialized, then deserialized by the tasks during > query execution, which constructs another instance of the UDF. > > > > -- > *From:* Anirudh Paramshetti > *Sent:* Tuesday, February 02, 2016 6:29 AM > *To:* user

Re: GenericUDF

2016-02-02 Thread Jason Dere
. From: Anirudh Paramshetti Sent: Tuesday, February 02, 2016 6:29 AM To: user@hive.apache.org Subject: GenericUDF Hi, I have written a custom UDF in Java extending the GenericUDF class. I have some print statements in the constructor and initialize method, as to understand

GenericUDF

2016-02-02 Thread Anirudh Paramshetti
Hi, I have written a custom UDF in Java extending the GenericUDF class. I have some print statements in the constructor and initialize method, as to understand the number of calls made to them. From what I have read about GenericUDF, I was expecting the constructor and initialize method to be

GenericUDF configure method not called for ORC tables

2015-03-24 Thread Rahul Sharma
. It works for every other kind of table but for ORC table like above, the configure method of the GenericUDF is not called. Any thoughts on this?

hive genericudf : possible to output column headers ?

2014-04-07 Thread Viral Bajaria
the data with column headers and let the downstream tools figure out how to consume it. Is it possible to output columns headers through a hive genericudf ? I looked around for example but could not find anything. Thanks, Viral

Re: GenericUDF Testing in Hive

2014-02-05 Thread Jason Dere
: SemanticException [Error 10011]: Line 1:25 Invalid function 'List' > > > > > On Tuesday, February 4, 2014 2:34 PM, Raj Hadoop wrote: > How to test a Hive GenericUDF which accepts two parameters List, T > > List -> Can it be the output of a collect set. P

Re: GenericUDF Testing in Hive

2014-02-04 Thread Raj Hadoop
4 2:34 PM, Raj Hadoop wrote: How to test a Hive GenericUDF which accepts two parameters List, T List -> Can it be the output of a collect set. Please advise. I have a generic udf which takes List, T. I want to test it how it works through Hive. On Monday, January 20, 2014 5:19 PM, Raj H

Re: GenericUDF Testing in Hive

2014-02-04 Thread Raj Hadoop
How to test a Hive GenericUDF which accepts two parameters List, T List -> Can it be the output of a collect set. Please advise. I have a generic udf which takes List, T. I want to test it how it works through Hive. On Monday, January 20, 2014 5:19 PM, Raj Hadoop wrote:  

GenericUDF Testing in Hive

2014-01-20 Thread Raj Hadoop
  The following is a an example for a GenericUDF. I wanted to test this through a Hive query. Basically want to pass parameters some thing like "select ComplexUDFExample('a','b',&#x

Re: A GenericUDF Function to Extract a Field From an Array of Structs

2013-04-02 Thread Navis류승우
Inspector soi = > ObjectInspectorFactory.getStandardStructObjectInspector(test, test2); > > fieldNames.add("productCategory"); > > fieldObjectInspectors.add(PrimitiveObjectInspectorFactory.writableStringObjectInspector); > > Gener

RE: A GenericUDF Function to Extract a Field From an Array of Structs

2013-03-28 Thread Peter Chu
DeferredObject = new MyDeferredObject(test2); GenericUDF extract_product_category = new GenericUDFExtractProductCategory(); extract_product_category.initialize(new ObjectInspector[]{firstInspector}); extract_product_category.evaluate(new DeferredObject[]{firstDeferredObject});

A GenericUDF Function to Extract a Field From an Array of Structs

2013-03-28 Thread Peter Chu
I am trying to write a GenericUDF function to collect all of a specific struct field(s) within an array for each record, and return them in an array as well. I wrote the UDF (as below), and it seems to work but: 1) It does not work when I am performing this on an external table, it works fine on

RE: GenericUdf and Jdbc issues

2012-06-01 Thread Maoz Gelbart
lto:edlinuxg...@gmail.com] Sent: Tuesday, May 29, 2012 4:58 PM To: user@hive.apache.org Subject: Re: GenericUdf and Jdbc issues So. this.getResourceAsStream(filename) is a very tricky method to get right especially in hive which you have the hive-classpath, the hadoop-classpath, the hive-jdbc c

Re: GenericUdf and Jdbc issues

2012-05-29 Thread Edward Capriolo
fs distribution 1.1.1. > > I wrote a GenericUDF packaged as a Jar that attempts to open a local > resource during its initialization at initialize(ObjectInspector[] > arguments) command. > > > > When I run with the CLI, everything is fine. > > When I run using Clou

GenericUdf and Jdbc issues

2012-05-29 Thread Maoz Gelbart
Hi all, I am using Hive 0.7.1 over Cloudera's Hadoop distribution 0.20.2 and MapR hdfs distribution 1.1.1. I wrote a GenericUDF packaged as a Jar that attempts to open a local resource during its initialization at initialize(ObjectInspector[] arguments) command. When I run with th