Re: Map Explode

2011-05-19 Thread Ranjit Mathew
On 05/18/2011 09:18 PM, Quinn Gil wrote: Is there an open source UDF to explode a Map (like explode for an array) that has key and value columns for each row? See: https://issues.apache.org/jira/browse/HIVE-1735 https://issues.apache.org/jira/browse/HIVE-1734 HTH, Ranjit

//hive 0.70.0 client start is err . but hive 0.50.0 client start sucessful.

2011-05-19 Thread Jeff Zhao(Zhifeng)
I install hadoop and hive ,hadoop version is 0.20.2 ,hive version is 0.70.0 , Step I : bin/hive --service hiveserver & I find hive server start atrer I run jps .the result is : 6314 HMaster 12746 RunJar 13189 Jps 9152 JobTracker 8886 NameNode 12203 NetworkServerControl 6251 HQuorumPeer 9052 Seco

Re: Can Hive 0.7 Rebuild partitions ?

2011-05-19 Thread Ashutosh Chauhan
Indeed a useful feature: created jira for it: https://issues.apache.org/jira/browse/HIVE-2173 Ashutosh On Thu, May 19, 2011 at 15:52, Roberto Congiu wrote: > I agree it's useful, especially for external tables, that may be loaded by > an external process that may 'forget' to issue a ADD PARTITION

Re: Can Hive 0.7 Rebuild partitions ?

2011-05-19 Thread Roberto Congiu
I agree it's useful, especially for external tables, that may be loaded by an external process that may 'forget' to issue a ADD PARTITION. A 'sync partitions' feature to sync metadata with directories would be really handy. On Thu, May 19, 2011 at 3:23 PM, Igor Tatarinov wrote: > That's Amazon's

Re: Can Hive 0.7 Rebuild partitions ?

2011-05-19 Thread Igor Tatarinov
That's Amazon's extension to Hive and it's really handy. On Thu, May 19, 2011 at 2:01 PM, Tim Spence wrote: > Is this functionality handled by ALTER TABLE [name] RECOVER PARTITIONS? > Take a look at this presentation for context: > http://www.slideshare.net/AmazonWebServices/aws-office-hours-amaz

Re: Can Hive 0.7 Rebuild partitions ?

2011-05-19 Thread Tim Spence
Is this functionality handled by ALTER TABLE [name] RECOVER PARTITIONS? Take a look at this presentation for context: http://www.slideshare.net/AmazonWebServices/aws-office-hours-amazon-elastic-mapreduce Best of luck, Tim On Thu, May 19, 2011 at 2:25 AM, Jasper Knulst wrote: > Hi, > > I have

Re: Can Hive 0.7 Rebuild partitions ?

2011-05-19 Thread Ashish Thusoo
afaik there is nothing like that currently. File a feature for this on the JIRA? Ashish On May 19, 2011, at 2:25 AM, Jasper Knulst wrote: > Hi, > > I have a partitioned external table on Hive 0.7. New subfolders are regularly > added to the base table HDFS folder. > I now have to perform this

Re: multiple hive access

2011-05-19 Thread labtrax
The metastore is not actually the problem here. I already configured hive metastore with mysql. And I use hive with jdbc. The question is, what does "The HiveServer is currently single threaded, which could present serious use limitations" means? Might the results wrong because multiple queries

Next SF HUG: June 8, at RichRelevance

2011-05-19 Thread Aaron Kimball
We had a great time after the Cloudera hackathon last week with our monthly SF Hadoop User Group meetup. I'd like to thank Cloudera again for hosting such a successful event. Our next meetup will be held Wednesday, June 8, from 6pm to 8pm. This meetup will be hosted by our friends at RichRelevanc

Re: multiple hive access

2011-05-19 Thread bharath vissapragada
Hey, Embedded mode is used just for testing purposes and the only once process can connect to it at a time. Configure it as a local/remote metastore. Refer http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin for details . Hope this helps. Thanks and Regards. On Thu, May 19, 2011 at 3:

multiple hive access

2011-05-19 Thread labtrax
Hello, I am running a cloudera hadoop/hbase cluster. I trying to integrate hive with that. I need multiple (read) accesses to hive per Java/jdbc-client. Is this possible in any way? Following this http://wiki.apache.org/hadoop/Hive/HiveServer it might not be possible... But what does it means

Can Hive 0.7 Rebuild partitions ?

2011-05-19 Thread Jasper Knulst
Hi, I have a partitioned external table on Hive 0.7. New subfolders are regularly added to the base table HDFS folder. I now have to perform this scan myself and let an external tool create new partitions by generating and firing ALTER TABLE ADD PARTITION commands. Is there an easier way to have

hive hbase auxpath jars

2011-05-19 Thread labtrax
Hello, some questions about the hbase/hive integration: I am running a cloudera hadoop/hbase cluster. I want to get access with hive to hbase tables. This actually works fine with cli like sudo -u hdfs hive --auxpath /usr/lib/hive/lib/hive-hbase-handler-0.7.0-cdh3u0.jar,/usr/lib/hive/lib/hbase-0