Hello, This topic has been an active discussion internally at Cloudera and has been a source of confusion while onboarding new customers. Please take a look at the attached document.
This document discusses the differences between two bucket layouts in Ozone, OBS (OBJECT_STORE) and FSO (FILE_SYSTEM_OPTIMIZED), and proposes a solution to address the complexity of accessing volumes through S3 Gateway and Hadoop Filesystem. The proposal suggests using symbolic linking to expose FSO buckets via S3 Gateway or vice versa and dividing the functionality of OBS and FSO based on their compatibility with S3 APIs and Hadoop Filesystem. OBS should always be compatible with S3 APIs and have S3 bucket names, while FSO should always be compatible with Hadoop File System interface. The document also explains how to access FSO via S3 APIs and OBS via OFS addressing and the benefits of this approach, including transparent data sharing and a clear separation between applications using Ozone primarily as an S3 store and Hadoop FS-based apps. https://docs.google.com/document/d/1wVlbJX22yw84WowH6I4ni_pUvaxKDr9JLHHsEVOTYSA/edit# This document can be broken down into tasks that must be done across the stack once reviewed. Regards, Ritesh
