Re: GenericUDFRank UDF is not working as expected

2013-07-23 Thread Nitin Pawar
try rank(columntoberanked, columntobegrouped) in your case rank (userid, city) On Wed, Jul 24, 2013 at 3:47 AM, Shahar Glixman wrote: > Hello, > > I'm trying to use GenericUDFRank described in: > https://issues.apache.org/jira/browse/HIVE-2361, however, no matter > the query I use, the result

Reminder: Bay Area Hive user meetup at LinkedIn tomorrow (7/24)

2013-07-23 Thread Mohammad Islam
Please join us at LinkedIn (2025 Stierlin Court, Mountain View, CA) tomorrow at 6 PM for this month's Hive user meet up.We have a packed agenda : * Hive at LinkedIn, Mohammad Islam, Mark Wagner, and Karthik Ramasamy * Hive Server 2 at Yahoo!, Chris Drome * Hive on Tez, Gunt

Re: Calling same UDF multiple times in a SELECT query

2013-07-23 Thread Navis류승우
It will be called 4 times whatever you annotated on the UDF if you are using released version of hive. https://issues.apache.org/jira/browse/HIVE-4209 , which will be included in 0.12.0, will make that single UDF call by caching result. 2013/7/24 Sanjay Subramanian : > Thanks Jan > > I will mod m

GenericUDFRank UDF is not working as expected

2013-07-23 Thread Shahar Glixman
Hello, I'm trying to use GenericUDFRank described in: https://issues.apache.org/jira/browse/HIVE-2361, however, no matter the query I use, the result is not what I expected. Assume a user hive table with the format: Country, City, userId I'm running the following query: ADD JAR Rank.jar; CREATE

Re: Calling same UDF multiple times in a SELECT query

2013-07-23 Thread Sanjay Subramanian
Thanks Jan I will mod my UDF and test it out I want to make sure I understand your words here "The obvious condition is that it must always return the identical result when called with same parameters." If I can make sure that a call to the web service is successful it will always return same

Re: Calling same UDF multiple times in a SELECT query

2013-07-23 Thread Sanjay Subramanian
Hi Nitin Thanks Yes I did actually do a nested query but it spawns reducers that I did not want…I wanted to keep it to one select so that only mappers are called and then I can invoke several mappers to call the we b service Thanks sanjay From: Nitin Pawar mailto:nitinpawar...@gmail.com>> Rep

Re: Calling same UDF multiple times in a SELECT query

2013-07-23 Thread Jan Dolinár
Hi, If you use annotation, Hive should be able to optimize it to single call: @UDFType(deterministic = true) The obvious condition is that it must always return the identical result when called with same parameters. Little bit more on this can be found in Mark Grovers post at http://mark.thegr

Re: Calling same UDF multiple times in a SELECT query

2013-07-23 Thread Nitin Pawar
fucntion return values are not stored for repeat use of same (as per my understanding) I know you may have already thought about other approach as select a , if (call <-1, -1 call) as b from (select a, fooudf(a) as call from table On Wed, Jul 24, 2013 at 12:42 AM, Sanjay Subramanian < sanjay.

Calling same UDF multiple times in a SELECT query

2013-07-23 Thread Sanjay Subramanian
Hi V r using version hive-exec-0.9.0-cdh4.1.2 in production I need to check and use the output from a UDF in a query to assign values to 2 columns in a SELECT query Example SELECT a, IF(fooUdf(a) < -1 , -1, fooUdf(a)) as b, IF(fooUdf(a) < -1 , fooUdf(a), 0) as c FROM my_h

Re: Hive-0.11.0 HCatalog configuration

2013-07-23 Thread Alan Gates
On Jul 23, 2013, at 1:03 AM, nabhajit wrote: > Hi, > > > I am trying to configure Hcatalog , which is now part of Hive-0.11.0. > > Do I have to make changes to the permission of the following files? > > $HCAT_HOME/bin/hcat and $HCAT_HOME/sbin/webhcat-server.sh Yes, this is a known issue and

Does HiveServer2 support delegation token?

2013-07-23 Thread Bing Li
Hi, all HiveMetastore supports delegation token. Does HiveServer2 support it as well? If not, do we have a plan for this? Besides, on hive wiki hive.server2.authentication - Authentication mode, default NONE. Options are NONE, KERBEROS, LDAP and CUSTOM Will HiveServer2 support PAM which could be

TimestampWritable in UDAF

2013-07-23 Thread Rouzbeh Safaie
Hi guys (hope this is the correct mailing list), I am writing a custom UDAF in Hive, one of the fields I am trying to merge is a Timestamp, in the terminatePartial function I have something like: ((TimestampWritable) partialResult[0]).set(dateBuffer.logtime); I have checked that the correct Time

Hive-0.11.0 HCatalog configuration

2013-07-23 Thread nabhajit
Hi, I am trying to configure Hcatalog , which is now part of Hive-0.11.0. Do I have to make changes to the permission of the following files? $HCAT_HOME/bin/hcat and $HCAT_HOME/sbin/webhcat-server.sh as, currently they do not have execute permission. Also, do webhcat-default.xml file needs