[
https://issues.apache.org/jira/browse/HIVE-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13958170#comment-13958170
]
Sergey Shelukhin commented on HIVE-6809:
----------------------------------------
left some comments on RB. My main concern is the breaking change to APIs which
hcat and the like might be using.
It's also a bit concerning that depending on partition spec the path will be
different and different optimization will apply.
Can we do this on the "new" path, and for old path just keep it as if it is
deprecated?
> Support bulk deleting directories for partition drop with partial spec
> ----------------------------------------------------------------------
>
> Key: HIVE-6809
> URL: https://issues.apache.org/jira/browse/HIVE-6809
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor
> Reporter: Navis
> Assignee: Navis
> Attachments: HIVE-6809.1.patch.txt
>
>
> In busy hadoop system, dropping many of partitions takes much more time than
> expected. In hive-0.11.0, removing 1700 partitions by single partial spec
> took 90 minutes, which is reduced to 3 minutes when deleteData is set false.
> I couldn't test this in recent hive, which has HIVE-6256 but if the
> time-taking part is mostly from removing directories, it seemed not helpful
> to reduce whole processing time.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
