[
https://issues.apache.org/jira/browse/HIVE-22971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Vary updated HIVE-22971:
------------------------------
Fix Version/s: 4.0.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
Pushed to master.
Thanks for the patch [~klcopp]!
> Eliminate file rename in insert-only compactor
> ----------------------------------------------
>
> Key: HIVE-22971
> URL: https://issues.apache.org/jira/browse/HIVE-22971
> Project: Hive
> Issue Type: Improvement
> Reporter: Karen Coppage
> Assignee: Karen Coppage
> Priority: Major
> Labels: ACID, compaction
> Fix For: 4.0.0
>
> Attachments: HIVE-22971.01.patch, HIVE-22971.02.patch,
> HIVE-22971.03.patch, HIVE-22971.04.patch, HIVE-22971.05.patch,
> HIVE-22971.06.patch, HIVE-22971.06.patch, HIVE-22971.06.patch,
> HIVE-22971.06.patch
>
>
> File rename is expensive for object stores, so MM (insert-only) compaction
> should skip that step when committing and write directly to base_x_cZ or
> delta_x_y_cZ.
> This also fixes the issue that for MM QB compaction the temp tables were
> stored under the table directory, and these temp dirs were never cleaned up.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
