Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-12 Thread Sreenath Menon
By instance I mean a set of mapreduce jobs (3 in this case)..when executing in Cli only one instance runs and output is displayed on the screen, but this is not the case when using with PowerPivot (multiple instance one after the other and contains the same no. of HDFS read write...etc)...a

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-12 Thread Sreenath Menon
There are multiple instances of 3 mpareduce jobs (executing one after the other) on running the single query using powerpivot. I can find out next instance when this throws up in the screen after like 2 instance of the 3mapreduce jobs. Hive history file=/tmp/hadoop/hive_job_log_hadoop_201206121120_

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-12 Thread Sreenath Menon
Yes understood. I do not have a problem in defining the parameters in the code. But the problem is, I am using PowerPivot as the visualization engine. Now, when I give the query as a set like: add jar /usr/local/hadoop/src/retweetlink1.jar; create temporary function link as

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Nitin Pawar
I got that -i option is not applicable to hive server let me drill through to find out if there is any other option on the other side to be curious , if you are writing the code to access hiveserver, whats the harm defining these parameters in your code? On Tue, Jun 12, 2012 at 12:12 PM, Sreenat

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Sreenath Menon
Like is there anyway to make the .hiverc file be executed even in hiveserver instance. simple way like this hive --service hiveserver -i .hiverc doesnot work Nithin

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Sreenath Menon
Any other way Nitin, I just want to add a single jar file and do not know much about custom hive build. And this requirement may vary at some other point of time. Its not a good way of building hive each time I need a new jar to be added.

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Nitin Pawar
aniket, his problem is that he does not want to create that function each time. he wants it available on each session with hive server so we are suggesting custom hive build where he will bundle his udf with hive and have available with hive server On Tue, Jun 12, 2012 at 11:58 AM, Aniket Mokashi

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Aniket Mokashi
I mean every time you connect to hive server- execute- create temporary function...; your hive query...; ~Aniket On Mon, Jun 11, 2012 at 11:27 PM, Aniket Mokashi wrote: > put jar in hive-classpath (libs directory etc) and do a create temporary > function every time you connect from server. > >

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Aniket Mokashi
put jar in hive-classpath (libs directory etc) and do a create temporary function every time you connect from server. What version of hive are you on? ~Aniket On Mon, Jun 11, 2012 at 11:12 PM, Sreenath Menon wrote: > I have a jar file : 'twittergen.jar', now how can I add it to hive lib. > Kind

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Sreenath Menon
I have a jar file : 'twittergen.jar', now how can I add it to hive lib. Kindly help. I need the function to be used across sections when running a server instance. Now stuck up with this.

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Nitin Pawar
you can checkout hive code and build your udf and ship it with hive :) custom hive for yourself ... if the function is generic feel free to share on git :) On Mon, Jun 11, 2012 at 9:28 PM, Sreenath Menon wrote: > Ya UDF do not live across section. But what if I just want the temporary > function

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Sreenath Menon
Ya UDF do not live across section. But what if I just want the temporary function to be created each time of a new session. This is what is done with help of .hiverc. But again this is working only with cli mode not in server mode. BTW I am interested to know how to build the function into hive, k

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Edward Capriolo
UDF's do not live across session. This is why the syntax is "CREATE TEMPORARY FUNCTION". You can build the function into hive and then you will not need to add the UDF. On Mon, Jun 11, 2012 at 11:31 AM, Sreenath Menon wrote: > I have tried that before. It does not work. But anyways thanks for th

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Sreenath Menon
Nithin, Any idea on invoking .hiverc when running : /usr/hive/bin/hive --service hiveserver

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Sreenath Menon
This works when I am using Hive cli. i.e. When I give: select link(tweet) from tweetsdata; in the cli and defined the function 'link' in .hiverc But when i run /usr/hive --service hiveserver And use the function in PowerPivot, then it says that 'link' is not defined.

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Nitin Pawar
if you have created a file other than name ".hiverc" , you will need to start hive with this file something like hive -i hiverc but when you create a file .hiverc in your home directory hive cli picks it up automatically On Mon, Jun 11, 2012 at 6:13 PM, Sreenath Menon wrote: > K..so i have cre

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Sreenath Menon
K..so i have created a file 'sample.hiverc' in the home directory..how do I run this particular file

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Nitin Pawar
in your home directory (if you are using linux with vm) then you will need to create that file and add the entries exactly the same way you add in hive cli On Mon, Jun 11, 2012 at 6:06 PM, Sreenath Menon wrote: > Hi Nitin > > Can u kindly help me (briefly) on how to add to hiverc...no such loca

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Sreenath Menon
Hi Nitin Can u kindly help me (briefly) on how to add to hiverc...no such location exsist in my machine

Re: Hive UDF support across sections...when running in hiveserver...help

2012-06-11 Thread Nitin Pawar
include it in your ~/.hiverc to have it across sessions On Mon, Jun 11, 2012 at 5:42 PM, Sreenath Menon wrote: > Hi > > I am using Hive with Microsoft PowerPivot as the visualization tool. > > When I am running a query involving UDF like this from PowerPivot: > add jar /usr/local/hadoop/src/retwe