;>>
>>> ​During initialize() you can call SessionState.get(), if it is not null
>>> then this initialize() call is happening during query compilation, and you
>>> can then use SessionState.get().getConf() to get the configuration.
>>> GenericUDFBaseNumeric has an example of thi
Maybe someone might have a suggestion.
From: Rahul Sharma mailto:kippy@gmail.com>>
Sent: Wednesday, August 26, 2015 9:39 AM
To: user@hive.apache.org<mailto:user@hive.apache.org>
Subject: Re: UDF Configure method not getting called
Thanks again Ja
might have a suggestion.
>
>
>
> --
> *From:* Rahul Sharma
> *Sent:* Wednesday, August 26, 2015 9:39 AM
>
> *To:* user@hive.apache.org
> *Subject:* Re: UDF Configure method not getting called
>
> Thanks again Jason. I tried hive.fetch.task.conversion=minimal/none
st 26, 2015 9:39 AM
To: user@hive.apache.org
Subject: Re: UDF Configure method not getting called
Thanks again Jason. I tried hive.fetch.task.conversion=minimal/none and it ran
a map-reduce task and the UDF ran fine. The problem with this approach is that
the property needs to be changed in conf.ser
---
> *From:* Rahul Sharma
> *Sent:* Tuesday, August 25, 2015 2:48 PM
> *To:* user@hive.apache.org
> *Subject:* Re: UDF Configure method not getting called
>
> Or alternatively, is there a way to pass configuration without using the
> configure method?
>
> The co
n try
hive.fetch.task.conversion=minimal/none and
hive.optimize.constant.propagation=false and see how it works.
From: Rahul Sharma
Sent: Tuesday, August 25, 2015 2:48 PM
To: user@hive.apache.org
Subject: Re: UDF Configure method not getting called
Or alternativel
Or alternatively, is there a way to pass configuration without using the
configure method?
The configuration to the UDF is essentially a list of parameters that tells
the UDF, what it should morph into this time and what kind of work it
should perform. If there is an all encompassing way to do tha
Oh thanks for the reply, Jason. That was my suspicion too.
The UDF in our case is not a function per say in pure mathematical sense of
the word 'function'. That is because, it doesn't take in a value and give
out another value. It has side effects, that form input for another
MapReduce job. The po
?There might be a few cases where a UDF is executed locally and not as part of
a Map/Reduce job?:
- Hive might choose not to run a M/R task for your query (see
hive.fetch.task.conversion)
- If the UDF is deterministic and has deterministic inputs, Hive might decide
to run the UDF once to get
Also seems like the UDF is being run on the client machine (I am using
beeline). No map reduce job gets spawned. I have removed limit clause as I
found that solved the issue for someone else in the mailing list. However,
still no luck. I looked at the MapredContext class's needConfigure method
and
10 matches
Mail list logo
