[
https://issues.apache.org/jira/browse/HIVE-24753?focusedWorklogId=557804&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-557804
]
ASF GitHub Bot logged work on HIVE-24753:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 25/Feb/21 08:56
Start Date: 25/Feb/21 08:56
Worklog Time Spent: 10m
Work Description: zchovan commented on pull request #2017:
URL: https://github.com/apache/hive/pull/2017#issuecomment-785731823
@pvargacl
The Cleaner changes are planned for a separate commit. I agree that the
scenarios you've mentioned have to be tested, but without the final cleaner
changes they don't really make sense here.
The way I see it, the Cleaner first checks if the partition still exists in
the HMS, if it doesn't, then the partition has not been yet recreated and the
whole location dir can be deleted, no compaction needed.
If the partition exists that means that between the dropPartition and the
compaction's start the partition was recreated and should be compacted, e.g the
files created before the truncated/deleted base file was written can be
compacted/deleted.
This still leaves the last scenario where the Cleaner is already running and
the partition is recreated, so yeah that should be checked and tested.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 557804)
Time Spent: 2h (was: 1h 50m)
> Non blocking DROP PARTITION implementation
> ------------------------------------------
>
> Key: HIVE-24753
> URL: https://issues.apache.org/jira/browse/HIVE-24753
> Project: Hive
> Issue Type: New Feature
> Reporter: Zoltan Chovan
> Assignee: Zoltan Chovan
> Priority: Major
> Labels: pull-request-available
> Time Spent: 2h
> Remaining Estimate: 0h
>
> Implement a way to execute drop partition operations in a way that doesn't
> have to wait for currently running read operations to be finished.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
