[
https://issues.apache.org/jira/browse/HIVE-28596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stamatis Zampetakis resolved HIVE-28596.
----------------------------------------
Fix Version/s: 4.1.0
Resolution: Fixed
Fixed in
https://github.com/apache/hive/commit/d4cef17160a3137dd43b98312a0e550e823ed05e
Thanks for the reviews [~difin], [~soumyakanti.das], [~zhangbutao]!
> Skip ColumnAccessInfo collection when not needed to speed-up compilation
> ------------------------------------------------------------------------
>
> Key: HIVE-28596
> URL: https://issues.apache.org/jira/browse/HIVE-28596
> Project: Hive
> Issue Type: Improvement
> Security Level: Public(Viewable by anyone)
> Reporter: Stamatis Zampetakis
> Assignee: Stamatis Zampetakis
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.1.0
>
>
> Avoid paying the perf-overhead of collecting {{ColumnAccessInfo}} via the
> {{HiveRelFieldTrimmer}} when it is not necessary.
> Currently, we only use the {{ColumnAccessInfo}} when we need to perform
> column based authorization or when it is requested explicitly by the user via
> the hive.stats.collect.scancols property.
> The field trimmer is an expensive operation and can become pretty slow for
> certain use-cases/queries so skipping some calls when it is not necessary is
> in general beneficial and can notably improve the compilation time for some
> queries.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
