Xuebin Su has uploaded a new patch set (#18). ( http://gerrit.cloudera.org:8080/22014 )
Change subject: IMPALA-13154: Update metrics when loading an HDFS table ...................................................................... IMPALA-13154: Update metrics when loading an HDFS table Previously, some table metrics, such as the estimated memory usage and the number of files, were only updated when a "FULL" Thrift object of the table is requested. As a result, if a user ran a DESCRIBE command on a table, and then tried to find the table on the Top-N page of the web UI, the user would not find it. This patch fixes the issue by updating the table metrics as soon as an HDFS table is loaded. With this, no matter what Thrift object type of the table is requested, the metrics will always be updated and displayed on the web UI. Testing: - Added two custom cluster tests in test_web_pages.py to make sure that table stats can be viewed on the web UI after DESCRIBE, for both legacy and local catalog modes. Change-Id: I6e2eb503b0f61b1e6403058bc5dc78d721e7e940 --- M fe/src/main/java/org/apache/impala/catalog/FileMetadataLoader.java M fe/src/main/java/org/apache/impala/catalog/HdfsPartition.java M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java M fe/src/main/java/org/apache/impala/catalog/IcebergFileMetadataLoader.java M fe/src/main/java/org/apache/impala/catalog/ParallelFileMetadataLoader.java M fe/src/test/java/org/apache/impala/testutil/ImpaladTestCatalog.java M tests/custom_cluster/test_web_pages.py 7 files changed, 146 insertions(+), 78 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/14/22014/18 -- To view, visit http://gerrit.cloudera.org:8080/22014 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I6e2eb503b0f61b1e6403058bc5dc78d721e7e940 Gerrit-Change-Number: 22014 Gerrit-PatchSet: 18 Gerrit-Owner: Xuebin Su <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Noemi Pap-Takacs <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Xuebin Su <[email protected]> Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
