How to migrate transaction tables across clusters(Hive-3.1.0)

2025-05-12 Thread 243776...@qq.com
The following is my attempt at operation

1.execute "ALTER TABLE test.a PARTITION(datets='2025-05-06') COMPACT 'MAJOR'" 
on my transaction table,and I can confirm that compact execute successfully by 
executing "SHOW COMPACTIONS"
2.execute "distcp" copy data which has been compact to the other HDFS
3.create new table on the HDFS location, and execute "msck repair table test.a" 
But In the end, I couldn't find the data.

By the way, I have one other question, how to migrate transaction table to 
normal orc table(with no acid but stored as orc format)




243776...@qq.com


Re: Re: Migrating Hive 3 to Hive 4

2025-05-20 Thread 243776...@qq.com
Hive 3 cannot read ACID tables created by Hive 4, as Hive 4 is forward 
compatible only, not backward compatible.