[
https://issues.apache.org/jira/browse/HIVE-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190721#comment-15190721
]
Prasanth Jayachandran commented on HIVE-12988:
----------------------------------------------
I am seeing couples of issues with the patch so far.
1) INSERT OVERWRITE does not use threadpool. It uses rename codepath instead of
copyFiles.
2) I always see only one “MoveDir" thread active at any point out of the
default 25 threads.
INSERT INTO without this patch.. 468.388s
INSERT INTO with this patch.. 439.077s
> Improve dynamic partition loading IV
> ------------------------------------
>
> Key: HIVE-12988
> URL: https://issues.apache.org/jira/browse/HIVE-12988
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor
> Affects Versions: 1.2.0, 2.0.0
> Reporter: Ashutosh Chauhan
> Assignee: Ashutosh Chauhan
> Attachments: HIVE-12988.2.patch, HIVE-12988.2.patch,
> HIVE-12988.3.patch, HIVE-12988.4.patch, HIVE-12988.5.patch,
> HIVE-12988.6.patch, HIVE-12988.7.patch, HIVE-12988.patch
>
>
> Parallelize copyFiles()
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
