[
https://issues.apache.org/jira/browse/IMPALA-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Boglarka Egyed updated IMPALA-11518:
------------------------------------
Priority: Minor (was: Major)
> Use Iceberg stats for Table Stats if there's no stats in HMS
> ------------------------------------------------------------
>
> Key: IMPALA-11518
> URL: https://issues.apache.org/jira/browse/IMPALA-11518
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Zoltán Borók-Nagy
> Assignee: Dániel Gábor Vankó
> Priority: Minor
> Labels: impala-iceberg, ramp-up
>
> Currently we only use HMS stats, even for Iceberg tables:
> https://github.com/apache/impala/blob/14b9fb97b59de1749fd93b0469ff8ea6f030021d/fe/src/main/java/org/apache/impala/catalog/local/LocalTable.java#L163
> https://github.com/apache/impala/blob/master/fe/src/main/java/org/apache/impala/catalog/Table.java#L413
> IcebergTable and LocalIcebergTable should set 'tableStats_' based on Iceberg
> metadata.
> For tables without delete files we should always use Iceberg stats because it
> will be precise whereas HMS stats can be stale.
> For tables with delete files the HMS stats might be more precise as they take
> the deleted rows into account.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
