[ 
https://issues.apache.org/jira/browse/IMPALA-14176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Fang-Yu Rao updated IMPALA-14176:
---------------------------------
    Description: 
custom_cluster.test_concurrent_ddls.TestConcurrentDdls.test_ddls_with_invalidate_metadata()
 in 
[https://github.com/apache/impala/blame/master/tests/custom_cluster/test_concurrent_ddls.py]
 seems to be flaky. The test could fail with the following error message.
{code:java}
Stacktrace
conftest.py:407: in cleanup
    cleanup_database(client, db_name, True)
conftest.py:393: in cleanup_database
    "" if must_exist else "IF EXISTS", db_name))
common/impala_connection.py:686: in execute
    cursor.execute(sql_stmt, configuration=self.__query_options)
../infra/python/env-gcc10.4.0/lib/python2.7/site-packages/impala/hiveserver2.py:394:
 in execute
    self._wait_to_finish()  # make execute synchronous
../infra/python/env-gcc10.4.0/lib/python2.7/site-packages/impala/hiveserver2.py:484:
 in _wait_to_finish
    raise OperationalError(resp.errorMessage)
E   OperationalError: Query 02494739f9b0db33:4172daba00000000 failed:
E   ImpalaRuntimeException: Error making 'dropDatabase' RPC to Hive Metastore: 
E   CAUSED BY: NoSuchObjectException: 
hive.test_ddls_with_invalidate_metadata_9525e717.test_14 table not found
{code}
 

Sometimes I could also see the following error message.
{code:java}
custom_cluster/test_concurrent_ddls.py:78: in 
test_local_catalog_ddls_with_invalidate_metadata
    self._run_ddls_with_invalidation(unique_database, sync_ddl=False)
custom_cluster/test_concurrent_ddls.py:169: in _run_ddls_with_invalidation
    worker[i].get(timeout=100)
/data/jenkins/workspace/impala-asf-master-core-ozone-erasure-coding/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/multiprocessing/pool.py:572:
 in get
    raise self._value
E   AssertionError: Query 434d35fc7094287b:c3809b7b00000000 failed:
E     AnalysisException: Table already exists: 
test_local_catalog_ddls_with_invalidate_metadata_e78f2324.test_16_part
E     
E     
E   assert <bound method type.is_acceptable_error of <class 
'test_concurrent_ddls.TestConcurrentDdls'>>('Query 
434d35fc7094287b:c3809b7b00000000 failed:\nAnalysisException: Table already 
exists: 
test_local_catalog_ddls_with_invalidate_metadata_e78f2324.test_16_part\n\n', 
False)
E    +  where <bound method type.is_acceptable_error of <class 
'test_concurrent_ddls.TestConcurrentDdls'>> = 
<test_concurrent_ddls.TestConcurrentDdls object at 
0x7fa3e9d82d50>.is_acceptable_error
{code}
In the latter case, Impala coordinator threw an AnalysisException during the 
analysis of the query "{{alter table 
test_local_catalog_ddls_with_invalidate_metadata_e78f2324.test_16_part2 rename 
to test_local_catalog_ddls_with_invalidate_metadata_e78f2324.test_16_part}}".

  was:
custom_cluster.test_concurrent_ddls.TestConcurrentDdls.test_ddls_with_invalidate_metadata()
 in 
https://github.com/apache/impala/blame/master/tests/custom_cluster/test_concurrent_ddls.py
 seems to be flaky. The test could fail with the following error message.
{code}
Stacktrace
conftest.py:407: in cleanup
    cleanup_database(client, db_name, True)
conftest.py:393: in cleanup_database
    "" if must_exist else "IF EXISTS", db_name))
common/impala_connection.py:686: in execute
    cursor.execute(sql_stmt, configuration=self.__query_options)
../infra/python/env-gcc10.4.0/lib/python2.7/site-packages/impala/hiveserver2.py:394:
 in execute
    self._wait_to_finish()  # make execute synchronous
../infra/python/env-gcc10.4.0/lib/python2.7/site-packages/impala/hiveserver2.py:484:
 in _wait_to_finish
    raise OperationalError(resp.errorMessage)
E   OperationalError: Query 02494739f9b0db33:4172daba00000000 failed:
E   ImpalaRuntimeException: Error making 'dropDatabase' RPC to Hive Metastore: 
E   CAUSED BY: NoSuchObjectException: 
hive.test_ddls_with_invalidate_metadata_9525e717.test_14 table not found
{code}


Sometimes I could also see the following error message.
{code}
custom_cluster/test_concurrent_ddls.py:78: in 
test_local_catalog_ddls_with_invalidate_metadata
    self._run_ddls_with_invalidation(unique_database, sync_ddl=False)
custom_cluster/test_concurrent_ddls.py:169: in _run_ddls_with_invalidation
    worker[i].get(timeout=100)
/data/jenkins/workspace/impala-asf-master-core-s3-data-cache/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/multiprocessing/pool.py:572:
 in get
    raise self._value
E   AssertionError: Query 524d813b45fdcd95:28400bd100000000 failed:
E     AnalysisException: Table does not exist: 
test_local_catalog_ddls_with_invalidate_metadata_e78f2324.test_11_part
E     
E     
E   assert <bound method type.is_acceptable_error of <class 
'test_concurrent_ddls.TestConcurrentDdls'>>('Query 
524d813b45fdcd95:28400bd100000000 failed:\nAnalysisException: Table does not 
exist: 
test_local_catalog_ddls_with_invalidate_metadata_e78f2324.test_11_part\n\n', 
False)
E    +  where <bound method type.is_acceptable_error of <class 
'test_concurrent_ddls.TestConcurrentDdls'>> = 
<test_concurrent_ddls.TestConcurrentDdls object at 
0x7f621ae09290>.is_acceptable_error
{code}


> test_ddls_with_invalidate_metadata seems to be flaky
> ----------------------------------------------------
>
>                 Key: IMPALA-14176
>                 URL: https://issues.apache.org/jira/browse/IMPALA-14176
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Fang-Yu Rao
>            Assignee: Michael Smith
>            Priority: Major
>              Labels: broken-build
>
> custom_cluster.test_concurrent_ddls.TestConcurrentDdls.test_ddls_with_invalidate_metadata()
>  in 
> [https://github.com/apache/impala/blame/master/tests/custom_cluster/test_concurrent_ddls.py]
>  seems to be flaky. The test could fail with the following error message.
> {code:java}
> Stacktrace
> conftest.py:407: in cleanup
>     cleanup_database(client, db_name, True)
> conftest.py:393: in cleanup_database
>     "" if must_exist else "IF EXISTS", db_name))
> common/impala_connection.py:686: in execute
>     cursor.execute(sql_stmt, configuration=self.__query_options)
> ../infra/python/env-gcc10.4.0/lib/python2.7/site-packages/impala/hiveserver2.py:394:
>  in execute
>     self._wait_to_finish()  # make execute synchronous
> ../infra/python/env-gcc10.4.0/lib/python2.7/site-packages/impala/hiveserver2.py:484:
>  in _wait_to_finish
>     raise OperationalError(resp.errorMessage)
> E   OperationalError: Query 02494739f9b0db33:4172daba00000000 failed:
> E   ImpalaRuntimeException: Error making 'dropDatabase' RPC to Hive 
> Metastore: 
> E   CAUSED BY: NoSuchObjectException: 
> hive.test_ddls_with_invalidate_metadata_9525e717.test_14 table not found
> {code}
>  
> Sometimes I could also see the following error message.
> {code:java}
> custom_cluster/test_concurrent_ddls.py:78: in 
> test_local_catalog_ddls_with_invalidate_metadata
>     self._run_ddls_with_invalidation(unique_database, sync_ddl=False)
> custom_cluster/test_concurrent_ddls.py:169: in _run_ddls_with_invalidation
>     worker[i].get(timeout=100)
> /data/jenkins/workspace/impala-asf-master-core-ozone-erasure-coding/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/multiprocessing/pool.py:572:
>  in get
>     raise self._value
> E   AssertionError: Query 434d35fc7094287b:c3809b7b00000000 failed:
> E     AnalysisException: Table already exists: 
> test_local_catalog_ddls_with_invalidate_metadata_e78f2324.test_16_part
> E     
> E     
> E   assert <bound method type.is_acceptable_error of <class 
> 'test_concurrent_ddls.TestConcurrentDdls'>>('Query 
> 434d35fc7094287b:c3809b7b00000000 failed:\nAnalysisException: Table already 
> exists: 
> test_local_catalog_ddls_with_invalidate_metadata_e78f2324.test_16_part\n\n', 
> False)
> E    +  where <bound method type.is_acceptable_error of <class 
> 'test_concurrent_ddls.TestConcurrentDdls'>> = 
> <test_concurrent_ddls.TestConcurrentDdls object at 
> 0x7fa3e9d82d50>.is_acceptable_error
> {code}
> In the latter case, Impala coordinator threw an AnalysisException during the 
> analysis of the query "{{alter table 
> test_local_catalog_ddls_with_invalidate_metadata_e78f2324.test_16_part2 
> rename to 
> test_local_catalog_ddls_with_invalidate_metadata_e78f2324.test_16_part}}".



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to