[
https://issues.apache.org/jira/browse/IMPALA-13500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900159#comment-17900159
]
Sai Hemanth Gantasala commented on IMPALA-13500:
------------------------------------------------
The ParallelFileMetadataLoader running asynchronously is missing the catalog
delta update. Adding a delay in the test before verifying the log lines can
help solve the problem.
{code:java}
I1120 23:44:56.379101 5566 MetaStoreUtil.java:223] Fetched 3/3 partitions for
table test_invalidate_stale_partition_on_reload_382624f9.test_invalidate_table
I1120 23:44:56.383416 5566 HdfsTable.java:3093] Setting the latest refresh
event id to 69727 for the reloaded 3 partitions
I1120 23:44:56.383474 5566 HdfsTable.java:3096] for table
test_invalidate_stale_partition_on_reload_382624f9.test_invalidate_table, file
metadataOps: FORCE_LOAD, refreshing file metadata for 3 out of 3 partitions to
reload in reloadPartitions()
I1120 23:44:56.383857 5566 ParallelFileMetadataLoader.java:224] Refreshing
file and block metadata for 3 paths for table
test_invalidate_stale_partition_on_reload_382624f9.test_invalidate_table using
a thread pool of size 3
I1120 23:44:56.386138 5571 JniUtil.java:167] getCatalogDelta request: Getting
catalog delta from version 2128
I1120 23:44:56.420725 5566 HdfsTable.java:836] Loaded file and block metadata
for test_invalidate_stale_partition_on_reload_382624f9.test_invalidate_table
partitions: p=1, p=0, p=2. Time taken: 37.077ms
I1120 23:44:56.421579 5566 MetastoreEvents.java:2828] Ignoring 3 events
between event id 69724 and 69726 since they modify parameters which can be
ignored
I1120 23:44:56.427090 5566 MetastoreEventsProcessor.java:1373] Time elapsed in
processing event batch: 75.818ms
I1120 23:44:56.432494 5571 JniUtil.java:178] Finished getCatalogDelta request:
Getting catalog delta from version 2128. Time spent: 46ms{code}
> test_invalidate_stale_partition_on_reload is flaky
> --------------------------------------------------
>
> Key: IMPALA-13500
> URL: https://issues.apache.org/jira/browse/IMPALA-13500
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog, Frontend
> Reporter: Riza Suminto
> Assignee: Sai Hemanth Gantasala
> Priority: Major
> Labels: broken-build
>
> TestEventProcessingCustomConfigs.test_invalidate_stale_partition_on_reload is
> flaky in ARM build for not finding log lines it is looking for.
> {code:java}
> Error Message
> AssertionError: Expected 1 lines in file
> /data0/jenkins/workspace/impala-asf-master-core-asan-arm/repos/Impala/logs/custom_cluster_tests/impalad.impala-ec2-rhel88-m7g-4xlarge-ondemand-1e5d.vpc.cloudera.com.jenkins.log.INFO.20241030-041545.3408110
> matching regex 'Invalidated objects in cache: \[partition
> test_invalidate_stale_partition_on_reload_382624f9.test_invalidate_table:p=\d
> \(id=0\)\]', but found 0 lines. Last line was: I1030 04:16:03.199949 3408505
> query-exec-mgr.cc:219] ReleaseQueryState(): deleted
> query_id=7745d0a812d0b474:7883f4f800000000
> Stacktrace
> custom_cluster/test_events_custom_configs.py:1328: in
> test_invalidate_stale_partition_on_reload
> self.assert_impalad_log_contains('INFO', log_regex % 0)
> common/impala_test_suite.py:1311: in assert_impalad_log_contains
> "impalad", level, line_regex, expected_count, timeout_s, dry_run)
> common/impala_test_suite.py:1364: in assert_log_contains
> (expected_count, log_file_path, line_regex, found, line)
> E AssertionError: Expected 1 lines in file
> /data0/jenkins/workspace/impala-asf-master-core-asan-arm/repos/Impala/logs/custom_cluster_tests/impalad.impala-ec2-rhel88-m7g-4xlarge-ondemand-1e5d.vpc.cloudera.com.jenkins.log.INFO.20241030-041545.3408110
> matching regex 'Invalidated objects in cache: \[partition
> test_invalidate_stale_partition_on_reload_382624f9.test_invalidate_table:p=\d
> \(id=0\)\]', but found 0 lines. Last line was:
> E I1030 04:16:03.199949 3408505 query-exec-mgr.cc:219] ReleaseQueryState():
> deleted query_id=7745d0a812d0b474:7883f4f800000000
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
