[
https://issues.apache.org/jira/browse/IMPALA-14141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17985002#comment-17985002
]
Joe McDonnell commented on IMPALA-14141:
----------------------------------------
Here are some test failures that we saw when the compactor was enabled:
query_test/test_orc_stats.py:
{noformat}
query_test/test_orc_stats.py:41: in test_orc_stats
self.run_test_case('QueryTest/orc-stats', vector, use_db=unique_database)
common/impala_test_suite.py:845: in run_test_case
update_section=pytest.config.option.update_results)
common/test_result_verifier.py:705: in verify_runtime_profile
% (function, field, expected_value, actual_value, op, actual))
E AssertionError: Aggregation of SUM over RowsRead did not match expected
results.
E EXPECTED VALUE:
E 50
E
E
E ACTUAL VALUE:
E 100
E
E OP:
E :{noformat}
query_test/test_acid.py:
{noformat}
query_test/test_acid.py:50: in test_acid_basic
self.run_test_case('QueryTest/acid', vector, use_db=unique_database)
common/impala_test_suite.py:818: in run_test_case
self.__verify_results_and_errors(vector, test_section, result, use_db)
common/impala_test_suite.py:625: in __verify_results_and_errors
replace_filenames_with_placeholder)
common/test_result_verifier.py:504: in verify_raw_results
VERIFIER_MAP[verifier](expected, actual)
common/test_result_verifier.py:313: in verify_query_result_is_equal
assert expected_results == actual_results
E assert Comparing QueryTestResults (expected vs actual):
E
row_regex:'hdfs://localhost:20500/test-warehouse/managed/functional_parquet.db/insert_only_major_and_minor_compacted_parquet/base_0000002_v\d+/000000_0','.+B','','NONE'
!=
'hdfs://localhost:20500/test-warehouse/managed/functional_parquet.db/insert_only_major_and_minor_compacted_parquet/base_0000006_v0001798/000000_0','520B','','NONE'
E Number of rows returned (expected vs actual): 4 != 1{noformat}
org.apache.impala.catalog.FileMetadataLoaderTest.testAcidMinorCompactionLoading:
{noformat}
java.lang.AssertionError: expected:<8> but was:<0>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at
org.apache.impala.catalog.FileMetadataLoaderTest.testAcidMinorCompactionLoading(FileMetadataLoaderTest.java:381){noformat}
> Disable auto compaction for a table in acid.test after HIVE-28662
> -----------------------------------------------------------------
>
> Key: IMPALA-14141
> URL: https://issues.apache.org/jira/browse/IMPALA-14141
> Project: IMPALA
> Issue Type: Bug
> Reporter: Fang-Yu Rao
> Assignee: Fang-Yu Rao
> Priority: Major
>
> HIVE-28662 revised some default Hive Metastore configurations, causing Hive
> to perform auto compaction against a table that is both major and minor
> compacted. This caused the test case involving the table
> '{{insert_only_major_and_minor_compacted}}' in
> [https://github.com/apache/impala/blob/master/testdata/workloads/functional-query/queries/QueryTest/acid.test]
> to fail. We should either disable auto compaction for this table, or update
> acid.test accordingly when the CDP Hive dependency starts to have HIVE-28662.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
