[
https://issues.apache.org/jira/browse/IMPALA-13267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Noémi Pap-Takács resolved IMPALA-13267.
---------------------------------------
Fix Version/s: Impala 5.0.0
Resolution: Fixed
> Number of partition is always 1 for Iceberg tables
> --------------------------------------------------
>
> Key: IMPALA-13267
> URL: https://issues.apache.org/jira/browse/IMPALA-13267
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Gabor Kaszab
> Assignee: Noémi Pap-Takács
> Priority: Major
> Labels: impala-iceberg
> Fix For: Impala 5.0.0
>
>
> Impala in general sees the Iceberg tables as unpartitioned and let's the
> partitioning happen within Iceberg. As a result the query profiles for the
> SCANs can be misleading when the number of partitions show always 1/1.
> We should either fix this or write 'N/A' or such instead of 1/1.
> Fixing might not be that straightforward because when planning the query
> Iceberg gives us a list of files to read but we don't know how they are
> aligned in terms of partitions. So we might have to do the files vs
> partitions matching ourselves.
> Wondering if we can enhance Iceberg ScanMetrics so that it not just hold the
> number of files, but the number of partitions too and then we can simply use
> this metric.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
