Re: [ANNOUNCE] Apache Hive 0.8.1 Released

2012-02-05 Thread shashwat shriparv
Way to go... keep up the work. you people and hive is really amazing thing Regards Shashwat On Mon, Feb 6, 2012 at 6:41 AM, Carl Steinbach wrote: > The Apache Hive team is proud to announce the the release of Apache > Hive version 0.8.1. > > The Apache Hive (TM) data warehouse software faci

[ANNOUNCE] Apache Hive 0.8.1 Released

2012-02-05 Thread Carl Steinbach
The Apache Hive team is proud to announce the the release of Apache Hive version 0.8.1. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides: * Tools to enable easy data extra

Re: Partition deletion w/out using a literal partition value

2012-02-05 Thread Evan Pollan
Thanks — that's what I suspected. I'm not sure HIVE-1003 would enable me to do what I want to do within a single HQL session, though… It looks like partition enumeration will be more performant (based on metastore rather than table data files), but I don't see any provision for anything other

Re: Partition deletion w/out using a literal partition value

2012-02-05 Thread Matt Tucker
Hive 0.8.0 has metadata optimizations ([HIVE-1003]), but your best bet is to write a shell script that executes 'show partitions ;', and then loop through the results and drop any partitions that meet your criteria. You can then create a cron job to

Partition deletion w/out using a literal partition value

2012-02-05 Thread Evan Pollan
I have an environment where I'm partitioning data in some hive tables by day. I'd like to be able to delete data that's older than 1 week in some tables and 1 month in others. It appears that ALTER TABLE DROP PARTITION only supports a partition spec that equates a partition with a literal val