Daniel Becker has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/22008


Change subject: IMPALA-13471: test_enable_reading_puffin() seems to fail in the 
Ozone build
......................................................................

IMPALA-13471: test_enable_reading_puffin() seems to fail in the Ozone build

The tests
TestIcebergWithPuffinStatsStartupFlag::test_[dis|en]able_reading_puffin
queried an Iceberg table that is created during normal dataload from
existing non-filesystem-specific metadata and data files. Therefore the
path of the Puffin stats file that is present in the metadata.json file
does not contain any filesystem-specific prefix, for which Puffin
reading does not work on Ozone.

Note that reading Puffin stats for tables that are created normally do
work on Ozone.

This change modifies the tests to create the table on the fly, modifying
the file path to include the filesystem-specific prefix.

Change-Id: I7afec1c70d7b43bae98289d65749b01ca720e7f7
---
M testdata/data/README
R 
testdata/data/iceberg_test/iceberg_with_puffin_stats/data/524c361b0ae84073-d6306ef200000000_1823051976_data.0.parq
D 
testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/20240906_085606_00006_wsfgs-4d9242d5-bd79-4069-be8b-2cfced8e0647.stats
A 
testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/20241028_142058_00006_dn7is-8d3be062-6b30-45ea-b26e-6b706c50f8e3.stats
R 
testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/989a6a68-ca7b-4339-adc2-cb5ba2656f0c-m0.avro
R 
testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/snap-8614787612208071008-1-989a6a68-ca7b-4339-adc2-cb5ba2656f0c.avro
M testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/v1.metadata.json
M testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/v2.metadata.json
M testdata/data/iceberg_test/iceberg_with_puffin_stats/metadata/v3.metadata.json
M tests/custom_cluster/test_iceberg_with_puffin.py
M tests/util/iceberg_metadata_util.py
11 files changed, 68 insertions(+), 43 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/08/22008/2
--
To view, visit http://gerrit.cloudera.org:8080/22008
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I7afec1c70d7b43bae98289d65749b01ca720e7f7
Gerrit-Change-Number: 22008
Gerrit-PatchSet: 2
Gerrit-Owner: Daniel Becker <[email protected]>
Gerrit-Reviewer: Fang-Yu Rao <[email protected]>
Gerrit-Reviewer: Noemi Pap-Takacs <[email protected]>
Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>

Reply via email to