We can also plan to enable Hadoop S3A contract tests on ozone S3 in upstream CI. https://hadoop.apache.org/docs/r3.4.1/hadoop-aws/tools/hadoop-aws/testing.html
I can create a task for myself if you feel this seems relevant. Thanks On Fri, Apr 18, 2025 at 11:08 PM Wei-Chiu Chuang <weic...@apache.org> wrote: > I'm collaborating with a bunch of contributors (Chung En Lee, Peter Lee and > others) to improve Ozone S3 compatibility. > > S3 API is many things. Major features are being developed: Lifecycle > management, storage class/tiering ... Here we're not implementing new > features, but just make sure the core APIs are well supported. > > * Tanvi had run MinIO Mint test suite against Ozone S3 gateway last year, > and uncovered a few corner cases. Some are being fixed. We should rerun it > and post the results in the Apache Jira. > > * I analyzed Ozone S3 robot tests and identified several scenarios that's > not tested. We should get them added. Chun En is taking the lead. > > * Peter is looking into Ceph S3 compatibility test suite ( > https://github.com/ceph/s3-tests) which appears to be the most > comprehensive s3 compat tool to date. But most of the test cases fail > because it attempts to delete buckets that are supposed to be empty but are > not. > > I have been talking to folks to understand where we are, and I'm sure there > are folks out there working on similar efforts. If you do, please let me > know so we can collaborate. Some of the tasks are being tracked under > HDDS-12716 <https://issues.apache.org/jira/browse/HDDS-12716> and some are > under HDDS-8423 <https://issues.apache.org/jira/browse/HDDS-8423>. > > Thanks! > Weichiu
