[
https://issues.apache.org/jira/browse/HIVE-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vineet Garg updated HIVE-24005:
-------------------------------
Description:
Currently whole {{SemanticAnalyzer}} object is cached. It is not necessary to
cache the whole object (caching requires set of tasks, query config and some
other info).
May be create a CachedPlan object.
HIVE-24009 is updating the approach to make a copy of operator tree and cache
it, it also changes various transient fields to non-transient so that they are
serialized/de-serialized and cached. We may not need to serialize/de-serialize
all the fields. It should be investigated to see what fields are absolutely
must, we should avoid the ones which are not required to reduce the overall
memory footprint of cache.
was:
Currently whole {{SemanticAnalyzer}} object is cached. It is not necessary to
cache the whole object (caching requires set of tasks, query config and some
other info).
May be create a CachedPlan object.
> Reduce memory footprint of cached plan
> --------------------------------------
>
> Key: HIVE-24005
> URL: https://issues.apache.org/jira/browse/HIVE-24005
> Project: Hive
> Issue Type: Sub-task
> Components: Query Planning
> Reporter: Vineet Garg
> Assignee: Vineet Garg
> Priority: Major
>
> Currently whole {{SemanticAnalyzer}} object is cached. It is not necessary to
> cache the whole object (caching requires set of tasks, query config and some
> other info).
> May be create a CachedPlan object.
> HIVE-24009 is updating the approach to make a copy of operator tree and cache
> it, it also changes various transient fields to non-transient so that they
> are serialized/de-serialized and cached. We may not need to
> serialize/de-serialize all the fields. It should be investigated to see what
> fields are absolutely must, we should avoid the ones which are not required
> to reduce the overall memory footprint of cache.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
