Re: Building dependencies into UDAF jar

2011-11-07 Thread Pradeep Kamath
Yes - please do share the script - appreciate the help! > >From: Mark Kerzner >To: user@hive.apache.org >Cc: Pradeep Kamath >Sent: Monday, November 7, 2011 11:48 AM >Subject: Re: Building dependencies into UDAF jar > > >To co

Re: Building dependencies into UDAF jar

2011-11-07 Thread Pradeep Kamath
then just a pom.xml can be a good starting point for me to try. If others have any ant friendly mechanisms for this, would greatly appreciate it. Thanks, Pradeep > >From: Frank Maritato >To: "user@hive.apache.org" ; Pradeep Kamath > &

Re: Building dependencies into UDAF jar

2011-11-07 Thread Pradeep Kamath
ting a jar which hive/hadoop will understand to be a "composite" jar containing main classes and other dependent jars? > >From: Frank Maritato >To: "user@hive.apache.org" ; Pradeep Kamath > >Sent: Monday, November 7, 2011 10:4

Building dependencies into UDAF jar

2011-11-07 Thread Pradeep Kamath
Hi,   I am trying to build a hive UDAF which has dependencies on other external jars (like log4j) - is there a way in which I can bundle the main classes for my UDAF and all the dependent jars into one jar for use in my hive query. I tried having my UDF classes at the top level and dependency j

RE: Does output directory remain in case of map/reduce task failures

2010-11-02 Thread Pradeep Kamath
case of map/reduce task failures Hive writes to a temporary directory first, and if the UDF fails, the temp. directory is removed. The expected final directory is not touched. -namit From: Pradeep Kamath [prade...@yahoo-inc.com] Sent: Tuesday, November 02

Does output directory remain in case of map/reduce task failures

2010-11-02 Thread Pradeep Kamath
Hi, While doing an insert into partitions if there is a failure in the map/reduce task (maybe due to a UDF bug), does hive cleanup the output directory corresponding to the partition? The behavior in hadoop is to NOT clean up output location in case of task failures (maybe to allow the user to