[
https://issues.apache.org/jira/browse/IMPALA-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18046131#comment-18046131
]
ASF subversion and git services commented on IMPALA-14617:
----------------------------------------------------------
Commit 3725b4ea63b32724b1a6904fdb4d11d4d6e9bdc6 in impala's branch
refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=3725b4ea6 ]
IMPALA-14617: Deflake TestMetadataReplicas.test_catalog_restart
TestMetadataReplicas.test_catalog_restart creates a db and an underlying
table in Hive, then expects an INVALIDATE command can bring up the table
in impalads. The test runs in the legacy catalogd mode that has the bug
of IMPALA-12103. So if the INVALIDATE command runs in a state that
catalgod has the db in cache but the db doesn't show up in impalad's
cache yet, catalogd will just return the table and impalad will skip it
due to db not exists. Then the above assertion fails.
The db is added in catalogd cache by processing the CREATE_DATABASE HMS
event, which is asynchronous with executing the INVALIDATE command. If
the command is triggered before that, the test passes. If the command is
triggered after that, the test fails.
When the test was written, we don't have HMS event processing yet. It's
expected that the db is also added in catalogd by the INVALIDATE
command. To deflake the issue, this patch disables HMS event processing
in this test, so catalogd always has a consistent cache with impalad
when executing the INVALIDATE command.
This patch also changes the log level of a log in ImpaladCatalog to warn
if a table is not added due to its db is missing.
Tests:
- Ran the test locally 10 times.
Change-Id: I2d17404cc8093eacf9b51df3d22caf5cbb6a61a9
Reviewed-on: http://gerrit.cloudera.org:8080/23798
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> TestMetadataReplicas.test_catalog_restart failing
> -------------------------------------------------
>
> Key: IMPALA-14617
> URL: https://issues.apache.org/jira/browse/IMPALA-14617
> Project: IMPALA
> Issue Type: Bug
> Reporter: Surya Hebbar
> Assignee: Riza Suminto
> Priority: Major
> Attachments: catalogd.INFO.gz, impalad.INFO.gz
>
>
> h3. Error Message
> {code}
> AssertionError: Unexpected exception: Query 7a4bb82a09ee3f84:09b239b300000000
> failed: AnalysisException: Database does not exist:
> test_catalog_restart_3b16a7b9 assert False
> {code}
> h3. Stacktrace
> {code}
> custom_cluster/test_metadata_replicas.py:80: in test_catalog_restart
> assert False, "Unexpected exception: " + str(e)
> E AssertionError: Unexpected exception: Query
> 7a4bb82a09ee3f84:09b239b300000000 failed:
> E AnalysisException: Database does not exist:
> test_catalog_restart_3b16a7b9
> E
> E
> E assert False
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
