Marton Bod created HIVE-22832:
---------------------------------

             Summary: Parallelise mm directory cleaning process
                 Key: HIVE-22832
                 URL: https://issues.apache.org/jira/browse/HIVE-22832
             Project: Hive
          Issue Type: Improvement
            Reporter: Marton Bod
            Assignee: Marton Bod


Inside Utilities::handleMmTableFinalPath, the cleanMmDirectories method is 
called sequentially for each element of the mmDirectory list, which might have 
a large number of elements depending on how many partitions were written. This 
current sequential execution could be improved by parallelising the clean up 
process. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to