Re: how to find number of elements in an array in Hive

2013-12-02 Thread Raj Hadoop
Thanks Brad On Monday, December 2, 2013 5:09 PM, Brad Ruderman wrote: Check out size https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF Thanks, Brad On Mon, Dec 2, 2013 at 5:05 PM, Raj Hadoop wrote: hi, > > >how to find number of elements in an array in Hive tabl

Any doc related to hive on hadoop 2.2?

2013-12-02 Thread Liu, Raymond
Hi It seems to me that a lot of hadoop 2.2 support work is done on trunk. While I don't find documentations related. So any doc I can refer to , say build / run BKM etc.? Especially those part related to Yarn Stable API in hadoop 2.2 since it changes a lot from alpha. Best Regards, Raymond Liu

Re: How to specify Hive auxiliary jar in HDFS, not local file system

2013-12-02 Thread Adam Kawa
You can use ADD JAR command inside a Hive script and a parameter in Oozie workflow definition. Example is here: http://blog.cloudera.com/blog/2013/01/how-to-schedule-recurring-hadoop-jobs-with-apache-oozie/ 2013/12/2 > Is it possible to specify a Hive auxiliary jar (like a SerDe) that is in > H

Re: how to find number of elements in an array in Hive

2013-12-02 Thread Brad Ruderman
Check out size https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF Thanks, Brad On Mon, Dec 2, 2013 at 5:05 PM, Raj Hadoop wrote: > hi, > > how to find number of elements in an array in Hive table? > > thanks, > Raj > >

how to find number of elements in an array in Hive

2013-12-02 Thread Raj Hadoop
hi, how to find number of elements in an array in Hive table? thanks, Raj

How to specify Hive auxiliary jar in HDFS, not local file system

2013-12-02 Thread mpeterson2
Is it possible to specify a Hive auxiliary jar (like a SerDe) that is in HDFS rather than the local fileystem? I am using a CsvSerDe I wrote and when I specify it Hive hive.aux.jars.path with a local file system path it works: hive -hiveconf hive.aux.jars.path=*file:*///path/to/truven-hive-serdes

Re: Trouble with large table joins when using a CSV SerDE

2013-12-02 Thread mpeterson2
I found a solution: set hive.auto.convert.join.noconditionaltask.size=2500; The default is 100MB. If I drop it to 25MB it now works. I ran this with my full 11-table join on production data and it finished successfully and in a reasonable amount of time. -Michael On Mon, Dec 2, 2013 at

Trouble with large table joins when using a CSV SerDE

2013-12-02 Thread mpeterson2
Hi, I recently wrote a CSV SerDe for Hive. It works in most scenarios, but I've found one situation where Hive is failing with it. I also tried the queries with the opensource CSV SerDe: https://github.com/ogrodnek and I see the same issue. So either we both wrote our SerDe incorrectly or there

Re: Using Hive with WebHCat

2013-12-02 Thread Jonathan Hodges
Hi, I have setup WebHCat that is bundled with Hive 0.11.0. I am able to kick of map reduce jobs with the REST API successfully. However I am having some issues with Hive commands over REST. The following is my $TEMPLETON_HOME/webhcat-site.xml. templeton.pig.archive s3n://pearso

RE: issue about hive command line

2013-12-02 Thread Sachin Sudarashana
Hi huang, Redirect the output to a file on the local file system. hive -e "DDL" > hive.log You can then go through the hive.log file to figure out if the query was successful or not. Thank you, Sachin -Original Message- From: "Garg, Rinku" Sent: ‎02-‎12-‎2013 13:39 To: "user@hive.apac

Re: issue about hive command line

2013-12-02 Thread ch huang
it's not worked ,when i write script,first way i used is what you suggested On Mon, Dec 2, 2013 at 8:07 PM, Nitin Pawar wrote: > try writing a wrong ddl and capture the command exit status with $? > > if thats what you are looking for > > > On Mon, Dec 2, 2013 at 5:34 PM, ch huang wrote: > >>

Re: issue about hive command line

2013-12-02 Thread Nitin Pawar
try writing a wrong ddl and capture the command exit status with $? if thats what you are looking for On Mon, Dec 2, 2013 at 5:34 PM, ch huang wrote: > i means how to judge if the hive DDL success or fail ,i figure it out by > myself ,i store the error output to a file ,then search FAIL text i

Re: issue about hive command line

2013-12-02 Thread ch huang
i means how to judge if the hive DDL success or fail ,i figure it out by myself ,i store the error output to a file ,then search FAIL text in the file,if not, success,if get ,fail On Mon, Dec 2, 2013 at 4:08 PM, Garg, Rinku wrote: > Set your hive home to $HIVE_HOME variable and execute the fol

RE: issue about hive command line

2013-12-02 Thread Garg, Rinku
Set your hive home to $HIVE_HOME variable and execute the following command. $HIVE_HOME/bin/hive -e "DDL" Thanks & Regards, Rinku Garg - Global Commercial Services From: ch huang [mailto:justlo...@gmail.com] Sent: 02 December 2013 13:22 To: user@hive.apache.org Subject: issue about hive comman