Re: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver

2010-10-13 Thread Narendra
The error happened again! The logs said hadoop was unable to create temp files required for mapreds. We freed up some space in the home directory and it started working again. On Wed, Oct 13, 2010 at 7:43 AM, Adarsh Sharma wrote: > Narendra wrote: > >> Even I am facing the same issue. In fact, s

RE: Exception in hive startup

2010-10-13 Thread Steven Wong
Before mucking with the code, it should be worth a try to clarify the wiki first. It's easy to miss the point that is build/dist for most people; I guess people tend to mistake for . I would replace all references to by build/dist and just mention once that, for advanced users, you can chang

Re: Exception in hive startup

2010-10-13 Thread Edward Capriolo
On Thu, Oct 14, 2010 at 12:49 AM, Ted Yu wrote: > This should be documented in README.txt > > On Wed, Oct 13, 2010 at 6:14 PM, Steven Wong wrote: >> >> You need to run hive_root/build/dist/bin/hive, not hive_root/bin/hive. >> >> >> >> >> >> From: hdev ml [mailto:hde...@gmail.com] >> Sent: Wednesd

Re: Exception in hive startup

2010-10-13 Thread Ted Yu
This should be documented in README.txt On Wed, Oct 13, 2010 at 6:14 PM, Steven Wong wrote: > You need to run hive_root/build/dist/bin/hive, not hive_root/bin/hive. > > > > > > *From:* hdev ml [mailto:hde...@gmail.com] > *Sent:* Wednesday, October 13, 2010 2:18 PM > *To:* hive-u...@hadoop.apach

Re: Exception in hive startup

2010-10-13 Thread Edward Capriolo
We really need to hide /bin/hive somewhere that people can not find it so easily. Edward On Wed, Oct 13, 2010 at 9:14 PM, Steven Wong wrote: > You need to run hive_root/build/dist/bin/hive, not hive_root/bin/hive. > > > > > > From: hdev ml [mailto:hde...@gmail.com] > Sent: Wednesday, October 13,

RE: Exception in hive startup

2010-10-13 Thread Steven Wong
You need to run hive_root/build/dist/bin/hive, not hive_root/bin/hive. From: hdev ml [mailto:hde...@gmail.com] Sent: Wednesday, October 13, 2010 2:18 PM To: hive-u...@hadoop.apache.org Subject: Exception in hive startup Hi all, I installed Hadoop 0.20.2 and installed hive 0.5.0. I followed all

Re: HBase as input AND output?

2010-10-13 Thread John Sichi
If your query only accesses HBase tables, then yes, Hive does not access any source data directly from HDFS (although of course it may put intermediate results in HDFS, e.g. for the result of a join). However, if your query does something like join a HBase table with a native Hive table, then i

RE: USING .. AS column names

2010-10-13 Thread Paul Yang
For insert overwrite, the column names don't matter - the order of the columns dictate how they are inserted into the table so the behavior is not specific to the transform clause. Also, when you use AS with transform, you're just assigning column aliases to the output of the transform. For exa

USING .. AS column names

2010-10-13 Thread Dave Brondsema
What are the "AS" columns used for in TRANSFORM USING? All I can find is http://wiki.apache.org/hadoop/Hive/LanguageManual/Transform#Schema-less_Map-reduce_Scriptsbut that only mentions what happens when it isn't there. It seems like it doesn't really matter what the column names are. And, more

Re: Exception in hive startup

2010-10-13 Thread Ted Yu
Make sure hive-exec-0.7.0.jar is under lib/ dir. Found: HiveConf Class: org.apache.hadoop.hive.conf.HiveConf Package: org.apache.hadoop.hive.conf Library Name: hive-exec-0.7.0.jar Library Path: /Users/tyu/hive/lib/hive-exec-0.7.0.jar On Wed, Oct 13, 2010 at 2:17 PM, hdev ml wrote: > Hi all, > >

Re: HBase as input AND output?

2010-10-13 Thread Otis Gospodnetic
Thanks Tim. (and sorry for the duplicate email - need to fix my Hive email filter) Just to clarify one bit, though. When using Hive without HBase one has data stored in the appropriate directories on HDFS and runs MR jobs against those data. But, when using Hive *with* HBase, does Hive require

Exception in hive startup

2010-10-13 Thread hdev ml
Hi all, I installed Hadoop 0.20.2 and installed hive 0.5.0. I followed all the instructions on Hive's getting started page for setting up environment variables like HADOOP_HOME When I run from command prompt in the hive installation folder as "bin/hive" it gives me following exception Exception

HBase as input AND output

2010-10-13 Thread Otis Gospodnetic
Hi, I was wondering how I can query data stored in HBase and remembered Hive's HBase integration: http://wiki.apache.org/hadoop/Hive/HBaseIntegration After watching John Sichi's video (http://developer.yahoo.com/blogs/hadoop/posts/2010/04/hundreds_of_hadoop_fans_at_the/ ) I have a better ide

Re: HBase as input AND output?

2010-10-13 Thread Tim Robertson
That's right. Hive can use an HBase table as an input format to the hive query regardless of output format, and can also write the output to an HBase table regardless of the input format. You can also supposedly do a join in Hive that uses 1 side of the join from an HBase table, and the other sid

HBase as input AND output?

2010-10-13 Thread Otis Gospodnetic
Hi, I was wondering how I can query data stored in HBase and remembered Hive's HBase integration: http://wiki.apache.org/hadoop/Hive/HBaseIntegration After watching John Sichi's video (http://developer.yahoo.com/blogs/hadoop/posts/2010/04/hundreds_of_hadoop_fans_at_the/ ) I have a better idea

Re: Hive 0.6.0 Release

2010-10-13 Thread David Lary
Thanks On Oct 13, 2010, at 2:52 PM, Otis Gospodnetic wrote: > David, > > Looks like the release was cut either last Friday or will be cut this coming > Friday: > > http://search-hadoop.com/?q=Hive+0.6.0 > > Otis > > Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch > Lucene ecos

Re: Hive 0.6.0 Release

2010-10-13 Thread Otis Gospodnetic
David, Looks like the release was cut either last Friday or will be cut this coming Friday: http://search-hadoop.com/?q=Hive+0.6.0 Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: Da

Re: boolean types thru a transform script

2010-10-13 Thread Dave Brondsema
Transform scripts only output text, so Hive has to convert from string to the column's data type (boolean in this case). So if you send an empty string "", that will be converted to boolean FALSE. FYI, on the way in to a transform script, booleans come through as strings "true" and "false". On T