Hello Quanlong Huang, Pranav Lodha, Michael Smith, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/23804
to look at the new patch set (#3).
Change subject: IMPALA-13863: Add metric to track number of loaded tables in
catalogd
......................................................................
IMPALA-13863: Add metric to track number of loaded tables in catalogd
Implements a real-time counter that tracks the number of loaded tables
(non-IncompleteTable instances) in the catalog. This helps monitor
catalog memory pressure and query performance impact from implicit table
invalidation mechanisms.
The counter uses AtomicInteger for thread-safety and is updated across
all table state transitions:
- Incremented when IncompleteTable is replaced with a loaded table
- Decremented when tables are invalidated, dropped, or aged out
- Reset to 0 on global INVALIDATE METADATA
Testing:
Manual verification and automated tests confirm correct behavior
across load, invalidate, drop, rename, refresh, and timeout scenarios.
Change-Id: I5aa54f9f7507709b654df22e24592799811e8b6c
---
M be/src/catalog/catalog-server.cc
M be/src/catalog/catalog-server.h
M common/thrift/JniCatalog.thrift
M common/thrift/metrics.json
M fe/src/main/java/org/apache/impala/catalog/CatalogObjectCache.java
M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
M fe/src/main/java/org/apache/impala/catalog/Db.java
M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java
M fe/src/main/java/org/apache/impala/service/JniCatalog.java
M tests/custom_cluster/test_automatic_invalidation.py
M tests/webserver/test_web_pages.py
11 files changed, 306 insertions(+), 8 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/04/23804/3
--
To view, visit http://gerrit.cloudera.org:8080/23804
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I5aa54f9f7507709b654df22e24592799811e8b6c
Gerrit-Change-Number: 23804
Gerrit-PatchSet: 3
Gerrit-Owner: Arnab Karmakar <[email protected]>
Gerrit-Reviewer: Arnab Karmakar <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Michael Smith <[email protected]>
Gerrit-Reviewer: Pranav Lodha <[email protected]>
Gerrit-Reviewer: Quanlong Huang <[email protected]>
