%1' and dt < date
> '2015-02-01') or (user='raj' and substr(cust,-1) = 3) ;
>
>
>
> 1 dudu cust1 2015-01-22
> hdfs://quickstart.cloudera:8020/tmp/t/20150122/dudu/cust1/data.txt
>
> 2 dudu cust1 2015-01-22
> hdfs:/
22/dudu/cust1/data.txt
3 dudu cust1 2015-01-22
hdfs://quickstart.cloudera:8020/tmp/t/20150122/dudu/cust1/data.txt
10raj cust3 2015-02-04
hdfs://quickstart.cloudera:8020/tmp/t/bla/bla/bla/raj/yada/yada/yada/cust3/yyy/20150204/zzz/data.txt
From: Ma
… are just logical connections between certain values and specific directories …
From: Markovitz, Dudu [mailto:dmarkov...@paypal.com]
Sent: Monday, June 06, 2016 6:07 PM
To: user@hive.apache.org
Subject: RE: alter partitions on hive external table
Hi Raj
1. I don’t understand the reason
, 2016 6:02 AM
To: user@hive.apache.org
Subject: alter partitions on hive external table
Hi friends,
I have created partitions on hive external tables. partitions on
datetime/userid/customerId.
now i have to change the order of the partitions for the existing data for all
the dates.
order of the
so you are doing this for partition elimination?
it is a tough call whatever you do
Since userid is unique you can try
CLUSTERED BY (userid,datetime,customerid) INTO 256 BUCKETS
or try creating a new table based on new column partition and insert/select
part of data and see it actually improves
Hi Mich,
table type is external table. Yes, I am doing this for certain queries
where userid as the most significant column.
On Mon, Jun 6, 2016 at 12:35 PM, Mich Talebzadeh
wrote:
> That order datetime/userid/customerId looks more natural to me.
>
> Two questions:
>
> What is the type of table
That order datetime/userid/customerId looks more natural to me.
Two questions:
What is the type of table in Hive?
Are you doing this for certain queries where you think userid as the most
significant column is going to help queries better?
HTH
Dr Mich Talebzadeh
LinkedIn *
https://www.li
Hi
The first idea pops up is:
1. HDFS commands to copy your existing structure and data to support a
new partitions structure.
2. Create a new on temporary hive external table
3. (optional) if you created temporary table then drop old one and
insert ... select from temporary table.
Margu
Hi friends,
I have created partitions on hive external tables. partitions on
datetime/userid/customerId.
now i have to change the order of the partitions for the existing data for
all the dates.
order of the partition is custerid/userid/datetime.
Anyone can help me, how to alter the partitions
