Re: Building dependencies into UDAF jar

Yes - please do share the script - appreciate the help! > >From: Mark Kerzner >To: user@hive.apache.org >Cc: Pradeep Kamath >Sent: Monday, November 7, 2011 11:48 AM >Subject: Re: Building dependencies into UDAF jar > > >To convert your project to maven, generat

Re: Building dependencies into UDAF jar

Thanks Frank - yes, please do share the pom.xml - will try and figure out how to do it in ant - also if you can share how the assembly jar looks like (ex: where do the dependency jars sit, is there a custom classloader involved) etc it might help me replicate it in ant - if its too much trouble

Re: Building dependencies into UDAF jar

To convert your project to maven, generate a maven project in Eclipse or NetBeans (or IDEA :), and bring your source code into that projeuallct. Actually,I have a hacked script for doing this in a shell, do you need it? Mark On Mon, Nov 7, 2011 at 1:45 PM, Mark Kerzner wrote: > Here is an examp

Re: Building dependencies into UDAF jar

Here is an example of assembly plugin, https://github.com/markkerzner/HadoopInPracticeCode/blob/master/pom.xml Mark On Mon, Nov 7, 2011 at 1:38 PM, Frank Maritato wrote: > I'm not sure how to do this in ant, but it definitely works with > maven+assembly because this is what we do for our prod

Re: Building dependencies into UDAF jar

I'm not sure how to do this in ant, but it definitely works with maven+assembly because this is what we do for our production map reduce jobs and for our hive udf's. If you want I can probably dig up an example pom.xml that shows how to do this. -- Frank Maritato From: Pradeep Kamath mailto:pra

Re: Building dependencies into UDAF jar

Thanks for the suggestion Frank. Unfortunately I am using ant and am not very familiar with maven. Glancing through the link on maven-assembly-plugin, I am also not sure if the "assembly" created will work fine with hive/hadoop when the task runs on a remote node. Any way of creating a jar which

Re: Building dependencies into UDAF jar

Hi Pradeep, If you are using maven to build your code you can use the assembly plugin to produce a jar with dependencies. http://maven.apache.org/plugins/maven-assembly-plugin/ Hope this helps -- Frank Maritato From: Pradeep Kamath mailto:pradeep...@yahoo.com>> Reply-To: mailto:user@hive.apache

Building dependencies into UDAF jar

Hi,   I am trying to build a hive UDAF which has dependencies on other external jars (like log4j) - is there a way in which I can bundle the main classes for my UDAF and all the dependent jars into one jar for use in my hive query. I tried having my UDF classes at the top level and dependency j

Re: Problem running Hive Jdbc Client

Thanks for replying Prasad. [Shame on me] The problem has been solved. I was following this tutorial : https://cwiki.apache.org/confluence/display/Hive/HiveClient And there is a script to run the HiveJdbcClient java aplication with the following script: #!/bin/bash HADOOP_HOME=/your/path/to/had