[ 
https://issues.apache.org/jira/browse/HIVE-22568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987241#comment-16987241
 ] 

Peter Vary commented on HIVE-22568:
-----------------------------------

CC: [~Rajkumar Singh] - this is back on the plate again. We decided to move 
forward with this parallelization with a parameter low enough not to kill the 
NameNode and the HMS

> Process compaction candidates in parallel by the Initiator
> ----------------------------------------------------------
>
>                 Key: HIVE-22568
>                 URL: https://issues.apache.org/jira/browse/HIVE-22568
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Denys Kuzmenko
>            Assignee: Denys Kuzmenko
>            Priority: Major
>         Attachments: HIVE-22568.1.patch
>
>
> `checkForCompaction` includes many file metadata checks and may be expensive. 
> Therefore, make sense using a thread pool here and running 
> `checkForCompactions` in parallel.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to