[
https://issues.apache.org/jira/browse/IMPALA-14416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Quanlong Huang updated IMPALA-14416:
------------------------------------
Attachment: catalogd-logs.txt
> JniFrontend.getDbs() could fail in InconsistentMetadataFetchException
> ---------------------------------------------------------------------
>
> Key: IMPALA-14416
> URL: https://issues.apache.org/jira/browse/IMPALA-14416
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Critical
> Attachments: catalogd-logs.txt, query_log.txt
>
>
> Saw a SHOW DATABASES command failed by InconsistentMetadataFetchException in
> local catalog mode:
> https://jenkins.impala.io/job/ubuntu-20.04-dockerised-tests/3986
> {noformat}
> I20250908 20:51:17.859867 60748 Frontend.java:2405]
> f74a2de0c6f403f2:b983af6600000000] Analyzing query: show databases db: default
> ...
> I20250908 20:51:17.876580 60748 CatalogdMetaProvider.java:1752]
> f74a2de0c6f403f2:b983af6600000000] Invalidated objects in cache: [list of
> database names, HMS_METADATA for DB test_drop_db_6d7dba7f_db]
> I20250908 20:51:17.876839 60748 jni-util.cc:321]
> f74a2de0c6f403f2:b983af6600000000]
> org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
> DATABASE failed: DB_NOT_FOUND for TCatalogObject(type:DATABASE,
> catalog_version:0, db:TDatabase(db_name:test_drop_db_6d7dba7f_db))
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.sendRequest(CatalogdMetaProvider.java:515)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.access$100(CatalogdMetaProvider.java:209)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider$2.call(CatalogdMetaProvider.java:742)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider$2.call(CatalogdMetaProvider.java:737)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:612)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.loadDb(CatalogdMetaProvider.java:734)
> at
> org.apache.impala.catalog.local.LocalDb.getMetaStoreDb(LocalDb.java:101)
> at org.apache.impala.catalog.local.LocalDb.toThrift(LocalDb.java:318)
> at
> org.apache.impala.service.JniFrontend.getDbs(JniFrontend.java:395){noformat}
> After getting the list of FeDb in JniFrontend.getDbs(), getting thrift
> objects for all of them triggers new GetPartialCatalogObject requests to
> catalogd which could fail if the db is removed concurrently in catalogd.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
