Quanlong Huang has posted comments on this change. ( http://gerrit.cloudera.org:8080/22956 )
Change subject: IMPALA-14107: Invalidate partition list if PARTITION_NOT_FOUND ...................................................................... Patch Set 5: (1 comment) http://gerrit.cloudera.org:8080/#/c/22956/4//COMMIT_MSG Commit Message: http://gerrit.cloudera.org:8080/#/c/22956/4//COMMIT_MSG@12 PS4, Line 12: : In local catalog mode, CatalogLookupStatus.PARTITION_NOT_FOUND response : from CatalogD will be followed by Coordinator invalidating table : metadata cache and table list of database. However, it does not : invalidate the partition list of requested table. This cause Coordinator : to re-request the same partition id that is not exist anymore in : CatalogD. This patch fix the issue by invalidating the partition list of : the table as well. > To be more specific, when I enable TRACE log over CatalogdMetaProvider, I c I think the problem is that catalogd updates the partition ids without updating the table version in CatalogOpExecutor#fireReloadEventAndUpdateRefreshEventId() for partition-level REFRESH. I left more details in the JIRA: https://issues.apache.org/jira/browse/IMPALA-14107?focusedCommentId=17957020&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17957020 It's OK to not invalidate the stale partition list as long as the corresponding table version is invalidated (then no one can find it). The stale list will be aged out and evicted from the cache eventually. -- To view, visit http://gerrit.cloudera.org:8080/22956 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I1bc91023d46a0b57916202d2b64e2cf07b687b74 Gerrit-Change-Number: 22956 Gerrit-PatchSet: 5 Gerrit-Owner: Riza Suminto <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Riza Suminto <[email protected]> Gerrit-Reviewer: Sai Hemanth Gantasala <[email protected]> Gerrit-Comment-Date: Mon, 09 Jun 2025 15:22:51 +0000 Gerrit-HasComments: Yes
