This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch auto-pick-47115-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from 7905e504a30 branch-3.0: [fix](doc) make cases for docs on sc same as
docs #46851 (#50475)
add ce66882eced [feature](iceberg) support s3 tables (#47115)
No new revisions were added by this update.
Summary of changes:
be/src/util/s3_util.cpp | 8 +-
be/src/util/s3_util.h | 2 +
fe/fe-core/pom.xml | 16 ++
.../datasource/iceberg/IcebergExternalCatalog.java | 1 +
.../iceberg/IcebergExternalCatalogFactory.java | 2 +
.../iceberg/IcebergS3TablesExternalCatalog.java | 66 +++++
.../s3tables/CustomAwsCredentialsProvider.java} | 27 +--
.../datasource/iceberg/source/IcebergScanNode.java | 1 +
.../datasource/property/S3ClientBEProperties.java | 8 +
.../property/constants/S3Properties.java | 2 +
.../org/apache/doris/persist/gson/GsonUtils.java | 3 +
.../datasource/property/PropertyConverterTest.java | 48 ++--
.../doris/datasource/s3tables/S3TablesTest.java | 87 +++++++
fe/pom.xml | 1 +
regression-test/conf/regression-conf.groovy | 8 +
.../iceberg/test_s3tables_insert_overwrite.out | Bin 0 -> 23561 bytes
.../iceberg/test_s3tables_write_insert.out} | Bin 79099 -> 41743 bytes
.../iceberg/test_s3tables_write_partitions.out | Bin 0 -> 267 bytes
.../iceberg/test_s3tables_insert_overwrite.groovy} | 254 ++-----------------
.../iceberg/test_s3tables_write_insert.groovy} | 269 ++-------------------
.../iceberg/test_s3tables_write_partitions.groovy | 108 +++++++++
21 files changed, 395 insertions(+), 516 deletions(-)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/IcebergS3TablesExternalCatalog.java
copy
fe/fe-core/src/main/java/{com/amazonaws/glue/catalog/credentials/ConfigurationAWSCredentialsProvider2x.java
=>
org/apache/doris/datasource/iceberg/s3tables/CustomAwsCredentialsProvider.java}
(53%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/s3tables/S3TablesTest.java
create mode 100644
regression-test/data/external_table_p2/iceberg/test_s3tables_insert_overwrite.out
copy
regression-test/data/{external_table_p0/iceberg/write/test_iceberg_insert_overwrite.out
=> external_table_p2/iceberg/test_s3tables_write_insert.out} (52%)
create mode 100644
regression-test/data/external_table_p2/iceberg/test_s3tables_write_partitions.out
copy
regression-test/suites/{external_table_p0/iceberg/write/test_iceberg_insert_overwrite.groovy
=> external_table_p2/iceberg/test_s3tables_insert_overwrite.groovy} (75%)
copy
regression-test/suites/{external_table_p0/iceberg/write/test_iceberg_write_insert.groovy
=> external_table_p2/iceberg/test_s3tables_write_insert.groovy} (74%)
create mode 100644
regression-test/suites/external_table_p2/iceberg/test_s3tables_write_partitions.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
