[
https://issues.apache.org/jira/browse/IMPALA-13737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17931324#comment-17931324
]
ASF subversion and git services commented on IMPALA-13737:
----------------------------------------------------------
Commit 91343369f7f34c0990129d565b9172001ee5570b in impala's branch
refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=91343369f ]
IMPALA-13785: Deflake test_catalog_tables_stats in exhaustive build
IMPALA-13737 changed how we load file metadata for Iceberg tables,
as we don't rely on the underlying HdfsTable anymore. As a result,
metrics were not correctly updated. This patch adds code to update
metrics correctly.
Testing:
* executed the tests in the title in exhaustive mode
* added Iceberg-specific tests to test_web_pages
Change-Id: I686e0e32b36ace4c5a8c9eeb715148c98521252a
Reviewed-on: http://gerrit.cloudera.org:8080/22531
Reviewed-by: Quanlong Huang <[email protected]>
Reviewed-by: Noemi Pap-Takacs <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Riza Suminto <[email protected]>
> Directly load file metadata via IcebergFileMetadataLoader
> ---------------------------------------------------------
>
> Key: IMPALA-13737
> URL: https://issues.apache.org/jira/browse/IMPALA-13737
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
> Fix For: Impala 4.6.0
>
>
> Currently we let HdfsTable to drive file metadata loading. To have better
> control over it IcebergTable should use IcebergFileMetadataLoader directly.
> The underlying HdfsTable can be empty, and it would also solve the
> de-duplication of file descriptors in Local Catalog mode.
> This is another step towards decoupling IcebergTable from HdfsTable.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
