[
https://issues.apache.org/jira/browse/IMPALA-14221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007355#comment-18007355
]
ASF subversion and git services commented on IMPALA-14221:
----------------------------------------------------------
Commit 41b6652fbf612a44676fed1cd9bd0da45133a04d in impala's branch
refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=41b6652fb ]
IMPALA-14221: Avoid hard-coding table list in TestWarmupCatalog
Some other tests like tests/query_test/test_cancellation.py might create
tables under the tpch db, which fails the assertion in TestWarmupCatalog
assuming that there are 8 tables under it.
This fixes the test by fetching the table list of tpch db in runtime
instead of hard-coding them.
Change-Id: I0aca8ee19146f2e63e7cd82177d9fce0b8c6736a
Reviewed-on: http://gerrit.cloudera.org:8080/23173
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> warmup_table tests failed due to missing config file and hard-coded table list
> ------------------------------------------------------------------------------
>
> Key: IMPALA-14221
> URL: https://issues.apache.org/jira/browse/IMPALA-14221
> Project: IMPALA
> Issue Type: Bug
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Major
> Labels: broken-build
> Attachments:
> catalogd.impala-ec2-centos79-m6i-4xlarge-xldisk-0393.vpc.cloudera.com.jenkins.log.INFO.20250712-195235.17537,
>
> catalogd.impala-ec2-centos79-m6i-4xlarge-xldisk-0393.vpc.cloudera.com.jenkins.log.INFO.20250712-195236.17625,
> file-list-begin-1.log.gz, file-list-end-1.log.gz
>
>
> These tests failed in Ozone builds:
> {noformat}
> custom_cluster.test_catalogd_ha.TestCatalogdHA.test_warmed_up_metadata_after_failover
> custom_cluster.test_restart_services.TestWarmupCatalog.test_warmup_tables_hdfs_config_file
> custom_cluster.test_restart_services.TestWarmupCatalog.test_keeps_warmup_tables_loaded{noformat}
> The failure is
> {code:python}
> custom_cluster/test_catalogd_ha.py:539: in
> test_warmed_up_metadata_after_failover
> self._test_warmed_up_tables(catalogd.service)
> custom_cluster/test_catalogd_ha.py:547: in _test_warmed_up_tables
> catalogd.verify_table_metadata_loaded(db, table)
> common/impala_service.py:612: in verify_table_metadata_loaded
> db, table, "loaded" if expect_loaded else "not loaded")
> E AssertionError: Timeout waiting table tpcds.customer to be loaded{code}
> Checked catalogd logs, the warmup tables config file is not loaded correctly:
> {noformat}
> --warmup_tables_config_file=ofs://localhost:9862/impala/test-warehouse/warmup_table_list.txt
> ...
> W20250712 19:52:38.293475 17537 FileSystemUtil.java:1293] Failed to load the
> list of warmup tables
> Java exception follows:
> java.io.FileNotFoundException: KEY_NOT_FOUND: Key:warmup_table_list.txt not
> found
> at
> org.apache.hadoop.fs.ozone.BasicRootedOzoneClientAdapterImpl.readFile(BasicRootedOzoneClientAdapterImpl.java:385)
> at
> org.apache.hadoop.fs.ozone.BasicRootedOzoneFileSystem.lambda$open$0(BasicRootedOzoneFileSystem.java:251)
> at
> org.apache.hadoop.hdds.tracing.TracingUtil.executeInSpan(TracingUtil.java:169)
> at
> org.apache.hadoop.hdds.tracing.TracingUtil.executeInNewSpan(TracingUtil.java:159)
> at
> org.apache.hadoop.fs.ozone.BasicRootedOzoneFileSystem.open(BasicRootedOzoneFileSystem.java:247)
> at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:960)
> at
> org.apache.impala.common.FileSystemUtil.loadWarmupTableNames(FileSystemUtil.java:1278)
> at
> org.apache.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:477)
> at org.apache.impala.service.JniCatalog.<init>(JniCatalog.java:168)
> I20250712 19:52:38.293606 17537 CatalogServiceCatalog.java:479] Loaded 0
> table names to warmup{noformat}
> Checked file-list-begin-1.log, the config file is not uploaded.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
