Parallelize UpdateInputAccessTimeHook
-------------------------------------
Key: HIVE-2026
URL: https://issues.apache.org/jira/browse/HIVE-2026
Project: Hive
Issue Type: Improvement
Reporter: Ning Zhang
Assignee: Ning Zhang
UpdateInputAccessTimeHook is usually used as a pre-execution hook to update the
metastore's lastAccessTime field of input partition/table. If a query touches a
large number of partitions, this hooks takes a long time to execute. One
approach is to make the hook itself to run in a separate thread. But it is hard
to guarantee backward compatibility in semantics in case of exceptions
encountered in the hook execution. This task takes another approach to
parallelize the hook itself (update multiple partitions concurrently), but
execute each pre-hook in sequential order.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
