Iceberg tables backed by HadoopTables and HadoopCatalog require an atomic rename. This is not yet supported with S3.
On Wed, Dec 2, 2020 at 3:20 PM Mass Dosage <massdos...@gmail.com> wrote: > Hello all, > > Yesterday AWS announced that S3 now has strong read-after-write > consistency: > > > https://aws.amazon.com/blogs/aws/amazon-s3-update-strong-read-after-write-consistency > > https://aws.amazon.com/s3/consistency/ > > Does this mean that Iceberg tables backed by HadoopTables and > HadoopCatalog can now be used on S3 in addition to HDFS? > > Thanks, > > Adrian >