[
https://issues.apache.org/jira/browse/IMPALA-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18112479#comment-18112479
]
Quanlong Huang commented on IMPALA-13117:
-----------------------------------------
There are some other improvements in this area: IMPALA-13789, IMPALA-13783,
IMPALA-14349, IMPALA-14800, IMPALA-15061, etc.
> Improve the heap usage during metadata loading and DDL/DML executions
> ---------------------------------------------------------------------
>
> Key: IMPALA-13117
> URL: https://issues.apache.org/jira/browse/IMPALA-13117
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Critical
> Labels: catalog-2024
> Attachments: Selection_125.png
>
>
> The JVM heap size of catalogd is not just used by the metadata cache. The
> in-progress metadata loading threads and DDL/DML executions also creates temp
> objects, which introduces spikes in the heap usage. We should improve the
> heap usage in this part, especially when the metadata loading is slow due to
> external slowness (e.g. listing files on S3).
> CC [[email protected]]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
