Mihaly Szjatinya created IMPALA-14202:
-----------------------------------------
Summary:
TestEventProcessingCustomConfigs.test_no_hms_event_incremental_refresh_transactional_table
fails with ACID table error
Key: IMPALA-14202
URL: https://issues.apache.org/jira/browse/IMPALA-14202
Project: IMPALA
Issue Type: Bug
Reporter: Mihaly Szjatinya
h3. Error Message
AssertionError: ACID table is not updated. Create statement: create
transactional table
test_no_hms_event_incremental_refresh_transactional_table_75c9c83d.tbl (i int)
assert [] == ['1', '2', '3'] Right contains more items, first extra item: '1'
Full diff: - [] + ['1', '2', '3']
h3. Stacktrace
custom_cluster/test_events_custom_configs.py:1305: in
test_no_hms_event_incremental_refresh_transactional_table assert results.data
== ["1", "2", "3"], ( E AssertionError: ACID table is not updated. Create
statement: create transactional table
test_no_hms_event_incremental_refresh_transactional_table_75c9c83d.tbl (i int)
E assert [] == ['1', '2', '3'] E Right contains more items, first extra item:
'1' E Full diff: E - [] E + ['1', '2', '3']
h3. Standard Error
-- 2025-07-06 16:43:28,142 INFO MainThread: Starting cluster with command:
/data/jenkins/workspace/impala-cdw-master-core-asan-arm/repos/Impala/bin/start-impala-cluster.py
'--state_store_args=--statestore_update_frequency_ms=50
--statestore_priority_update_frequency_ms=50
--statestore_heartbeat_frequency_ms=50' --cluster_size=3 --num_coordinators=3
--log_dir=/data/jenkins/workspace/impala-cdw-master-core-asan-arm/repos/Impala/logs/custom_cluster_tests
--log_level=1 '--state_store_args=-statestore_heartbeat_frequency_ms=100
-statestore_priority_update_frequency_ms=100 '
'--catalogd_args=--hms_event_incremental_refresh_transactional_table=false '
--impalad_args=--default_query_options= 16:43:28 MainThread: Found 0 impalad/0
statestored/0 catalogd process(es) 16:43:28 MainThread: Starting State Store
logging to
/data/jenkins/workspace/impala-cdw-master-core-asan-arm/repos/Impala/logs/custom_cluster_tests/statestored.INFO
16:43:28 MainThread: Starting Catalog Service logging to
/data/jenkins/workspace/impala-cdw-master-core-asan-arm/repos/Impala/logs/custom_cluster_tests/catalogd.INFO
16:43:28 MainThread: Starting Impala Daemon logging to
/data/jenkins/workspace/impala-cdw-master-core-asan-arm/repos/Impala/logs/custom_cluster_tests/impalad.INFO
16:43:28 MainThread: Starting Impala Daemon logging to
/data/jenkins/workspace/impala-cdw-master-core-asan-arm/repos/Impala/logs/custom_cluster_tests/impalad_node1.INFO
16:43:28 MainThread: Starting Impala Daemon logging to
/data/jenkins/workspace/impala-cdw-master-core-asan-arm/repos/Impala/logs/custom_cluster_tests/impalad_node2.INFO
16:43:30 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
16:43:30 MainThread: Waiting for Impalad webserver port 25000 16:43:31
MainThread: Waiting for Impalad webserver port 25000 16:43:31 MainThread:
Waiting for Impalad webserver port 25000 16:43:32 MainThread: Waiting for
Impalad webserver port 25000 16:43:32 MainThread: Waiting for Impalad webserver
port 25001 16:43:32 MainThread: Waiting for Impalad webserver port 25002
16:43:34 MainThread: Waiting for coordinator client services - hs2 port: 21050
hs2-http port: 28000 beeswax port: 21000 16:43:37 MainThread: Waiting for
coordinator client services - hs2 port: 21051 hs2-http port: 28001 beeswax
port: 21001 16:43:39 MainThread: Waiting for coordinator client services - hs2
port: 21052 hs2-http port: 28002 beeswax port: 21002 16:43:39 MainThread:
Getting num_known_live_backends from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25000 16:43:39
MainThread: num_known_live_backends has reached value: 3 16:43:39 MainThread:
Getting num_known_live_backends from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25001 16:43:39
MainThread: num_known_live_backends has reached value: 3 16:43:39 MainThread:
Getting num_known_live_backends from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25002 16:43:39
MainThread: num_known_live_backends has reached value: 3 16:43:39 MainThread:
Total wait: 8.61s 16:43:39 MainThread: Impala Cluster Running with 3 nodes (3
coordinators, 3 executors). -- 2025-07-06 16:43:39,522 DEBUG MainThread: Found
3 impalad/1 statestored/1 catalogd process(es) -- 2025-07-06 16:43:39,522 INFO
MainThread: Getting metric: statestore.live-backends from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25010 --
2025-07-06 16:43:39,525 INFO MainThread: Metric 'statestore.live-backends' has
reached desired value: 4. total_wait: 0s -- 2025-07-06 16:43:39,525 DEBUG
MainThread: Getting num_known_live_backends from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25000 --
2025-07-06 16:43:39,527 INFO MainThread: num_known_live_backends has reached
value: 3 -- 2025-07-06 16:43:39,527 DEBUG MainThread: Getting
num_known_live_backends from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25001 --
2025-07-06 16:43:39,529 INFO MainThread: num_known_live_backends has reached
value: 3 -- 2025-07-06 16:43:39,529 DEBUG MainThread: Getting
num_known_live_backends from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25002 --
2025-07-06 16:43:39,531 INFO MainThread: num_known_live_backends has reached
value: 3 -- 2025-07-06 16:43:39,532 INFO MainThread: beeswax: set
client_identifier=custom_cluster/test_events_custom_configs.py::TestEventProcessingCustomConfigs::()::test_no_hms_event_incremental_refresh_transactional_table;
-- 2025-07-06 16:43:39,532 INFO MainThread: beeswax: connected to
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:21000 with beeswax
-- 2025-07-06 16:43:39,532 INFO MainThread: hs2: set
client_identifier=custom_cluster/test_events_custom_configs.py::TestEventProcessingCustomConfigs::()::test_no_hms_event_incremental_refresh_transactional_table;
-- 2025-07-06 16:43:39,532 INFO MainThread: hs2: connected to
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:21050 with impyla
hs2 -- 2025-07-06 16:43:39,532 INFO MainThread: hs2-http: set
client_identifier=custom_cluster/test_events_custom_configs.py::TestEventProcessingCustomConfigs::()::test_no_hms_event_incremental_refresh_transactional_table;
-- 2025-07-06 16:43:39,532 INFO MainThread: hs2-http: connected to
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:28000 with impyla
hs2-http -- 2025-07-06 16:43:39,532 INFO MainThread: hs2-feng: set
client_identifier=custom_cluster/test_events_custom_configs.py::TestEventProcessingCustomConfigs::()::test_no_hms_event_incremental_refresh_transactional_table;
-- 2025-07-06 16:43:39,533 INFO MainThread: hs2-feng: connected to
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:11050 with impyla
hs2-feng -- 2025-07-06 16:43:39,534 INFO MainThread: hs2: set
client_identifier=custom_cluster/test_events_custom_configs.py::TestEventProcessingCustomConfigs::()::test_no_hms_event_incremental_refresh_transactional_table;
-- 2025-07-06 16:43:39,534 INFO MainThread: hs2: connected to
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:21050 with impyla
hs2 -- 2025-07-06 16:43:39,534 INFO MainThread: hs2: set
client_identifier=custom_cluster/test_events_custom_configs.py::TestEventProcessingCustomConfigs::()::test_no_hms_event_incremental_refresh_transactional_table;
-- 2025-07-06 16:43:39,534 INFO MainThread: hs2: set_configuration: set
sync_ddl=False; -- 2025-07-06 16:43:39,535 INFO MainThread: hs2: executing
against Impala at
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:21050. session:
0f438182215f3702:74aa4a81f5e20898 main_cursor: True user: None DROP DATABASE IF
EXISTS `test_no_hms_event_incremental_refresh_transactional_table_75c9c83d`
CASCADE; -- 2025-07-06 16:43:39,883 INFO MainThread:
fb4336892d69ebe0:14746ab000000000: query started -- 2025-07-06 16:43:39,884
INFO MainThread: fb4336892d69ebe0:14746ab000000000: getting log for operation
-- 2025-07-06 16:43:39,884 INFO MainThread: fb4336892d69ebe0:14746ab000000000:
getting runtime profile operation -- 2025-07-06 16:43:39,885 INFO MainThread:
fb4336892d69ebe0:14746ab000000000: closing query for operation -- 2025-07-06
16:43:39,888 INFO MainThread: hs2: executing against Impala at
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:21050. session:
0f438182215f3702:74aa4a81f5e20898 main_cursor: True user: None CREATE DATABASE
`test_no_hms_event_incremental_refresh_transactional_table_75c9c83d`; --
2025-07-06 16:43:40,309 INFO MainThread: 7941fb40d118f22c:0fddb8f200000000:
query started -- 2025-07-06 16:43:40,310 INFO MainThread:
7941fb40d118f22c:0fddb8f200000000: getting log for operation -- 2025-07-06
16:43:40,310 INFO MainThread: 7941fb40d118f22c:0fddb8f200000000: getting
runtime profile operation -- 2025-07-06 16:43:40,310 INFO MainThread:
7941fb40d118f22c:0fddb8f200000000: closing query for operation -- 2025-07-06
16:43:40,311 INFO MainThread: Created database
"test_no_hms_event_incremental_refresh_transactional_table_75c9c83d" for test
ID
"custom_cluster/test_events_custom_configs.py::TestEventProcessingCustomConfigs::()::test_no_hms_event_incremental_refresh_transactional_table"
-- 2025-07-06 16:43:40,311 INFO MainThread: hs2: closing 1 sync and 0 async
hs2 connections to:
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:21050 --
2025-07-06 16:43:40,313 INFO MainThread: -- executing in HiveServer2 create
transactional table
test_no_hms_event_incremental_refresh_transactional_table_75c9c83d.tbl (i int)
-- 2025-07-06 16:43:44,274 INFO MainThread: Waiting until events processor
syncs to event id:68943 -- 2025-07-06 16:43:44,934 DEBUG MainThread: Metric
last-synced-event-id has reached the desired value: 68943, outstanding events:
0 -- 2025-07-06 16:43:44,988 INFO MainThread: Getting metric:
catalog.curr-version from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25000 --
2025-07-06 16:43:45,002 INFO MainThread: Metric 'catalog.curr-version' has
reached desired value: 2206. total_wait: 0s -- 2025-07-06 16:43:45,002 INFO
MainThread: Getting metric: catalog.curr-version from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25001 --
2025-07-06 16:43:45,015 INFO MainThread: Metric 'catalog.curr-version' has
reached desired value: 2206. total_wait: 0s -- 2025-07-06 16:43:45,015 INFO
MainThread: Getting metric: catalog.curr-version from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25002 --
2025-07-06 16:43:45,029 INFO MainThread: Metric 'catalog.curr-version' has
reached desired value: 2206. total_wait: 0s -- 2025-07-06 16:43:45,430 INFO
MainThread: hs2: executing against Impala at
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:21050. session:
074e2b48d48ecf8e:c9018150facfa88e main_cursor: True user: None refresh
test_no_hms_event_incremental_refresh_transactional_table_75c9c83d.tbl; --
2025-07-06 16:43:45,905 INFO MainThread: d440390bfa8b2bbb:b4c3fde800000000:
query started -- 2025-07-06 16:43:45,905 INFO MainThread:
d440390bfa8b2bbb:b4c3fde800000000: getting log for operation -- 2025-07-06
16:43:45,905 INFO MainThread: d440390bfa8b2bbb:b4c3fde800000000: getting
runtime profile operation -- 2025-07-06 16:43:45,906 INFO MainThread:
d440390bfa8b2bbb:b4c3fde800000000: closing query for operation -- 2025-07-06
16:43:45,906 INFO MainThread: -- executing in HiveServer2 insert into
test_no_hms_event_incremental_refresh_transactional_table_75c9c83d.tbl values
(1),(2),(3) -- 2025-07-06 16:43:59,932 INFO MainThread: Waiting until events
processor syncs to event id:68947 -- 2025-07-06 16:44:00,896 DEBUG MainThread:
Metric last-synced-event-id has reached the desired value: 68947, outstanding
events: 0 -- 2025-07-06 16:44:00,924 INFO MainThread: Getting metric:
catalog.curr-version from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25000 --
2025-07-06 16:44:00,936 INFO MainThread: Metric 'catalog.curr-version' has
reached desired value: 2208. total_wait: 0s -- 2025-07-06 16:44:00,936 INFO
MainThread: Getting metric: catalog.curr-version from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25001 --
2025-07-06 16:44:00,948 INFO MainThread: Metric 'catalog.curr-version' has
reached desired value: 2208. total_wait: 0s -- 2025-07-06 16:44:00,948 INFO
MainThread: Getting metric: catalog.curr-version from
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:25002 --
2025-07-06 16:44:00,960 INFO MainThread: Metric 'catalog.curr-version' has
reached desired value: 2208. total_wait: 0s -- 2025-07-06 16:44:01,360 INFO
MainThread: hs2: executing against Impala at
impala-ec2-rhel88-m7g-4xlarge-ondemand-096c.vpc.cloudera.com:21050. session:
074e2b48d48ecf8e:c9018150facfa88e main_cursor: True user: None select i from
test_no_hms_event_incremental_refresh_transactional_table_75c9c83d.tbl; --
2025-07-06 16:44:01,908 INFO MainThread: 724c2b7ba73014d4:e33c49be00000000:
query started -- 2025-07-06 16:44:01,909 INFO MainThread:
724c2b7ba73014d4:e33c49be00000000: getting log for operation -- 2025-07-06
16:44:01,909 INFO MainThread: 724c2b7ba73014d4:e33c49be00000000: getting
runtime profile operation -- 2025-07-06 16:44:01,912 INFO MainThread:
724c2b7ba73014d4:e33c49be00000000: closing query for operation
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
