Hi Nir, Iceberg has a small interface you can use to adapt it to use any object store you like, called FileIO. The default FileIO implementation wraps a Hadoop FileSystem, so as long as there is a Hadoop FS you can use it with Iceberg. And if you want, you can implement the FileIO interface to avoid some of the performance costs that come with making the underlying system appear like a file system.
Ryan On Wed, May 19, 2021 at 9:44 AM Nir Haviv <nir.ha...@argus-sec.com> wrote: > Hello, > > I am developing a "cloud agnostic" product with support for on-prem > installation. > Currently i am using MinIO as a S3 abstraction layer, to support on-prem > or in the case of a cloud installation to connect to the > underlying storage, e.g: aws, gcs... > My question is, is it possible to use Iceberg with Minio? (i am also using > hive metastore (yes, and suffer also)) > > Thanks, Nir Haviv > -- Ryan Blue
