Hello Quanlong Huang, Sai Hemanth Gantasala, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/22956
to look at the new patch set (#5).
Change subject: IMPALA-14107: Invalidate partition list if PARTITION_NOT_FOUND
......................................................................
IMPALA-14107: Invalidate partition list if PARTITION_NOT_FOUND
test_reload_events_with_transient_partitions can get stuck when running
in local catalog mode. From the catalod.INFO, it looks like catalog keep
looking for non-existent partition id.
In local catalog mode, CatalogLookupStatus.PARTITION_NOT_FOUND response
from CatalogD will be followed by Coordinator invalidating table
metadata cache and table list of database. However, it does not
invalidate the partition list of requested table. This cause Coordinator
to re-request the same partition id that is not exist anymore in
CatalogD. This patch fix the issue by invalidating the partition list of
the table as well.
This patch also tweak HdfsTable.getPartialInfo() to directly gather all
partitions when Coordinator does not request for specific partitions.
Testing:
Split test_reload_events_with_transient_partitions into two setup:
legacy catalog mode and local catalog mode. Confirm that both tests
pass.
Change-Id: I1bc91023d46a0b57916202d2b64e2cf07b687b74
---
M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java
M fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java
M tests/custom_cluster/test_events_custom_configs.py
3 files changed, 50 insertions(+), 20 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/56/22956/5
--
To view, visit http://gerrit.cloudera.org:8080/22956
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I1bc91023d46a0b57916202d2b64e2cf07b687b74
Gerrit-Change-Number: 22956
Gerrit-PatchSet: 5
Gerrit-Owner: Riza Suminto <riza.sumi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Gerrit-Reviewer: Quanlong Huang <huangquanl...@gmail.com>
Gerrit-Reviewer: Riza Suminto <riza.sumi...@cloudera.com>
Gerrit-Reviewer: Sai Hemanth Gantasala <saihema...@cloudera.com>
