[
https://issues.apache.org/jira/browse/IMPALA-14398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18019896#comment-18019896
]
ASF subversion and git services commented on IMPALA-14398:
----------------------------------------------------------
Commit 968559da26bbea5a54987c6c2fafb62a03fbaabe in impala's branch
refs/heads/master from Riza Suminto
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=968559da2 ]
IMPALA-14398: Deflake test_load_table_with_primary_key_attr
test_load_table_with_primary_key_attr has been intermittently fail with
following error message since Python3 switch in IMPALA-14333.
dbm.error: db type could not be determined
Error happen inside load_unique_col_metadata. But both
load_unique_col_metadata and persist_unique_col_metadata are seemingly
unused anymore.
While the root cause is still unknown, commenting
load_unique_col_metadata in db_connection.py can make the tests pass.
Tests are not affected because the they do not assert against any unique
columns. This patch implement that workaround until we can revisit the
issue with query generator infrastructure.
Fix few flake8 warnings in db_connection.py.
Testing:
Loop and pass test_show_create_table 10 times using downstream jenkins.
Change-Id: I2caf6b9cc5a4f06237323cb32bbd47afef576fa1
Reviewed-on: http://gerrit.cloudera.org:8080/23412
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> test_load_table_with_primary_key_attr failed in S3 build
> --------------------------------------------------------
>
> Key: IMPALA-14398
> URL: https://issues.apache.org/jira/browse/IMPALA-14398
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Reporter: Zoltán Borók-Nagy
> Assignee: Riza Suminto
> Priority: Major
> Labels: broken-build
>
> h3. Error Message
> {noformat}
> /data/jenkins/workspace/impala-cdw-master-staging-core-s3/repos/Impala/tests/metadata/test_show_create_table.py:310:
> in test_load_table_with_primary_key_attr table =
> impala_testinfra_cursor.describe_table(table_primary_keys_map['table'])
> comparison/db_connection.py:426: in describe_table
> self.load_unique_col_metadata(table) comparison/db_connection.py:546: in
> load_unique_col_metadata with
> closing(shelve.open('/tmp/query_generator.shelve')) as store:
> /data/jenkins/workspace/impala-cdw-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-3.8.18/lib/python3.8/shelve.py:243:
> in open return DbfilenameShelf(filename, flag, protocol, writeback)
> /data/jenkins/workspace/impala-cdw-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-3.8.18/lib/python3.8/shelve.py:227:
> in __init__ Shelf.__init__(self, dbm.open(filename, flag), protocol,
> writeback)
> /data/jenkins/workspace/impala-cdw-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-3.8.18/lib/python3.8/dbm/__init__.py:89:
> in open raise error[0]("db type could not be determined") E dbm.error: db
> type could not be determined{noformat}
> h3. Stacktrace
> {noformat}
> /data/jenkins/workspace/impala-cdw-master-staging-core-s3/repos/Impala/tests/metadata/test_show_create_table.py:310:
> in test_load_table_with_primary_key_attr
> table =
> impala_testinfra_cursor.describe_table(table_primary_keys_map['table'])
> comparison/db_connection.py:426: in describe_table
> self.load_unique_col_metadata(table)
> comparison/db_connection.py:546: in load_unique_col_metadata
> with closing(shelve.open('/tmp/query_generator.shelve')) as store:
> /data/jenkins/workspace/impala-cdw-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-3.8.18/lib/python3.8/shelve.py:243:
> in open
> return DbfilenameShelf(filename, flag, protocol, writeback)
> /data/jenkins/workspace/impala-cdw-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-3.8.18/lib/python3.8/shelve.py:227:
> in __init__
> Shelf.__init__(self, dbm.open(filename, flag), protocol, writeback)
> /data/jenkins/workspace/impala-cdw-master-staging-core-s3/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-3.8.18/lib/python3.8/dbm/__init__.py:89:
> in open
> raise error[0]("db type could not be determined")
> E dbm.error: db type could not be determined{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
