[ 
https://issues.apache.org/jira/browse/IMPALA-14718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18060388#comment-18060388
 ] 

ASF subversion and git services commented on IMPALA-14718:
----------------------------------------------------------

Commit a3a725d8c6365537d6605dd94f52fa92e1e51c2a in impala's branch 
refs/heads/master from Noemi Pap-Takacs
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=a3a725d8c ]

IMPALA-14718: Fix flaky test test_confirm_individual_refresh

The flakiness was introduced by 'test_table_repair': it executed a
global INVALIDATE METADATA that affected other tests running in
parallel.

'test_confirm_individual_refresh' failed because it was running
in parallel with 'test_iceberg.py::test_table_repair', which ran
an INVALIDATE METADATA exactly before a SELECT query of
'test_confirm_individual_refresh', which was checking that data in
its table is not reloaded. Due to the global invalidate, the data
was reloaded anyway.

Fix: instead of global INVALIDATE METADATA, 'test_table_repair'
     only invalidates its own table now.

Change-Id: If798856ae9aa0c1cc429d49f0efd17acd7fa4333
Reviewed-on: http://gerrit.cloudera.org:8080/24011
Reviewed-by: Balazs Hevele <[email protected]>
Reviewed-by: Csaba Ringhofer <[email protected]>
Tested-by: Noemi Pap-Takacs <[email protected]>


> test_confirm_individual_refresh is flaky
> ----------------------------------------
>
>                 Key: IMPALA-14718
>                 URL: https://issues.apache.org/jira/browse/IMPALA-14718
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Balazs Hevele
>            Assignee: Noémi Pap-Takács
>            Priority: Major
>              Labels: broken-build, flaky-test
>
> TestRefreshPartition::test_confirm_individual_refresh is flaky.
>  
> It seems to fail very rarely with error:
> {noformat}
> metadata/test_refresh_partition.py:209: in test_confirm_individual_refresh
>     assert result.data == [str(0)]
> E   AssertionError: assert ['5000'] == ['0']
> E     At index 0 diff: '5000' != '0'
> E     Full diff:
> E     - ['0']
> E     + ['5000']
> E     ?   +++
>         dst_path   = 
> '/test-warehouse/test_confirm_individual_refresh_5e857700/year=2010/month=%s/alltypes.parq'
>         file_name  = 'alltypes.parq'
>         file_num_rows = 1000
>         month      = 5
>         result     = <tests.common.impala_connection.ImpylaHS2ResultSet 
> object at 0x7f8ef9096d60>
>         self       = 
> <tests.metadata.test_refresh_partition.TestRefreshPartition object at 
> 0x7f8ef90f2490>
>         src_file   = 
> '/test-warehouse/alltypesagg_parquet/year=2010/month=1/day=9/*.parq'
>         table_location = 
> '/test-warehouse/test_confirm_individual_refresh_5e857700'
>         table_name = 
> 'test_confirm_individual_refresh_5e857700.partition_test_table'
>         unique_database = 'test_confirm_individual_refresh_5e857700'
> {noformat}
>  
> An example is:
> https://jenkins.impala.io/job/ubuntu-20.04-dockerised-tests/4596/testReport/junit/metadata.test_refresh_partition/TestRefreshPartition/test_confirm_individual_refresh/



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to