[
https://issues.apache.org/jira/browse/IMPALA-12162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Smith updated IMPALA-12162:
-----------------------------------
Target Version: Impala 4.5.1
> makeInsertEventData() can be slow in fetching file checksums
> ------------------------------------------------------------
>
> Key: IMPALA-12162
> URL: https://issues.apache.org/jira/browse/IMPALA-12162
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Csaba Ringhofer
> Assignee: Michael Smith
> Priority: Critical
> Fix For: Impala 5.0.0
>
>
> Saw some INSERTs where most of the time was spent in
> https://github.com/apache/impala/blob/dc63ae514a445e3f197cab405b01a30c58015695/fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java#L7011
> This was surprising, as I assumed that most of the time in
> updateCatalog()/createInsertEvents() is spent in HMS RPCs, but in the jstacks
> I saw it was mainly in calls to HDFS to compute checksum of files.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
