Re: subdirectories in External tables.

U shud create partitions by date and add partitions by alter table cmnd daily U can then query data by date partition Sent from my iPhone On Aug 12, 2011, at 1:16 PM, Sam William wrote: > > I have a case where I want to dump data daily under > > /user/sampd/test/{date}. > > > I thought

Hive server with hiveconf parameters

Hi, How do I start the hiveserver with the -hiveconf parameters?    -Ayon See My Photos on Flickr Also check out my Blog for answers to commonly asked questions.

subdirectories in External tables.

I have a case where I want to dump data daily under /user/sampd/test/{date}. I thought of making this an external table on Hive so that I can just keep dumping data daily. In my external table definition , I specified the location as /user/sampd/test. But when I try to run a qu

Selectively include EXTERNAL TABLE source files via regex or symlink

I have a folder full of logs aggregated by hour like so: logs/ > 20110812-07 > 20110812-080000 > 20110812-09 > 20110812-100000 > ... > 20110812-23 > 20110813-00 > 20110813-01 > 20110813-02 > 20110813-03 > ... > Is there a way to s

RE: how to make the data in one table available to multiple tables?

One way is to create ly_sales as an external table and use ADD PARTITION ... LOCATION to point to the sales partitions. Unlike a non-external ("managed") table, an external table does not own its data, meaning when you DROP an external table or one of its partitions, the Hive metadata is deleted

RE: how to load data to partitioned table

If you want to insert data into a partitioned table without specifying the partition value, you need to enable dynamic partitioning. You can use the following switches: SET hive.exec.dynamic.partition=true; SET hive.exec.dynamic.partition.mode=nonstrict; Thanks Vaibhav From: Daniel,Wu [mailto:h

Re: multiple tables join with only one hug table.

A mapjoin does what you described: it builds hash tables for the smaller tables. In recent versions of hive (like the one i am using with cloudera cdh3u1) a mapjoin will be done for you automatically if you have your parameters set correctly. The relevant parameters in hive-site.xml are: hive.auto.

Re: how to load data to partitioned table

Hi Daniel Just having a look at your requirement , to load data into a partition based hive table from any input file the most hassle free approach would be. 1. Load the data into a non partitioned table that shares similar structure as the target table. 2. Populate the target table with t

Re: how to load data to partitioned table

Hey , Simpley you have run query like this FROM sales_temp INSERT OVERWRITE TABLE sales partition(period_key) SELECT * Regards Vikas Srivastava 2011/8/12 Daniel,Wu > suppose the table is partitioned by period_key, and the csv file also has > a column named as period_key. The csv file cont

unsubscribe