Re: index is not working for me.

Automatic usage of indexes is still under development (HIVE-1644). JVS On Apr 15, 2011, at 1:31 AM, Erix Yao wrote: > hi, > I installed the hive-0.7 release for the index feature. > Here's my test table schema: > > create table testforindex (id bigint, type int) row format delimited fields

Re: can I use hive dynamic partition while loading data into tables?

The open source Hive doesn't support this yet. Someone mentioned Amazone EMR extended it with this kind of functionality. On Apr 15, 2011, at 12:51 AM, Jasper Knulst wrote: Hi, I think you are looking for this: ALTER TABLE page_view ADD PARTITION (date='2008-06-08', country='US', type) LOCATI

Re: can I use hive dynamic partition while loading data into tables?

You can create an hourly partitioned table say H with the partition columns(dt, country, hour), then the INSERVER OVERWRITE command will become: ... INSERT OVERWRITE TABLE H... PARTITION (dt='...', country, hr) ... select ... country, hour .. You can also keep the old table page_view_stg's sch

Re: Hive 7

Hi soumya, I think 'Hive Wiki' is a good start point for you. See http://wiki.apache.org/hadoop/Hive - Youngwoo 2011/4/13 soumya mishra > Hello, > > I have to use Hive 7 for a project so wanted to know some details about it > and also if some one can forward

Re: Hive Server Error

Hi Ankit, I'm not sure but you can add a following property to hive-site.xml. hive.aux.jars.path file:///home/user/xxx.jar,file:///home/user/xxx2.jar So, add the property and restart hive server. - Youngwoo 2011/4/15 Ankit Jain > Hi, > I am able to launch the map-reduce job (select userid

Hive Server Error

Hi, I am able to launch the map-reduce job (select userid from user) from hive shell.I am also passing the auxpath parameter to the shell (specifying the Hive/HBase integration related jars). However,when i trying to launch the map-reduce job(select userid from User) from jdbc client.The map reduce

index is not working for me.

hi, I installed the hive-0.7 release for the index feature. Here's my test table schema: create table testforindex (id bigint, type int) row format delimited fields terminated by ',' lines terminated by '\n';; create index type_idx on table testforindex (type) AS 'org.apache.hadoop.hive.ql.in

Re: can I use hive dynamic partition while loading data into tables?

Hi, I think you are looking for this: ALTER TABLE page_view ADD PARTITION (date='2008-06-08', country='US', type) LOCATION '/'; So you can go on adding new hdfs subdir's (based on the partition naming) to you base hive hdfs table dir, moving extra files to these subdirs and making them available

Re: can I use hive dynamic partition while loading data into tables?

Oh, I see. just as the example we have: FROM page_view_stg pvs INSERT OVERWRITE TABLE page_view PARTITION(dt='2008-06-08', country) SELECT pvs.viewTime, pvs.userid, pvs.page_url, pvs.referrer_url, null, null, pvs.ip, pvs.country The dynamic partition we have is on country, and the

Re: can I use hive dynamic partition while loading data into tables?

The INSERT OVERWRITE command will not overwrite the whole table. If you specify a partition in that table, it will only overwrite that partition. If you specify dynamic partitions, it will only create/overwrite partitions that will be seen from the input query (pvs.country in the example). On

Re: can I use hive dynamic partition while loading data into tables?

Does this mean if I want the type field as the partition key , I will have to split the raw data by myself and load the files into the target table? I see there's an example in tutorial: FROM page_view_stg pvs INSERT OVERWRITE TABLE page_view PARTITION(dt='2008-06-08', country) SEL

Re: can I use hive dynamic partition while loading data into tables?

The LOAD DATA command only copy the files to the destination directory. It doesn't read the records of the input file, so it cannot do partitioning based on record values. On Apr 14, 2011, at 10:52 PM, Erix Yao wrote: hi,all The dynamic partition function is amazing ,but only works in inser