It was announced during the Subsurface keynote and I discuss it in this blog (if you need something to link to)
https://www.dremio.com/blog/the-nessie-ecosystem-and-the-reach-of-git-for-data-for-apache-iceberg/ Although some of press may conflate two announcements that came out of subsurface 1. Dremio adding rest catalog as a source support 2. Nessie adopting rest catalog interface (Reading through the press that came out of it most of it is worded emphasizing announcement #1, so I can see how #2 got lost in the mix) *Alex Merced <https://bio.alexmerced.com/data> * *Senior Tech Evangelist, Dremio **Dremio.com* <https://www.dremio.com/?utm_medium=email&utm_source=signature&utm_term=na&utm_content=email-signature&utm_campaign=email-signature>*/ **Follow Us on LinkedIn!* <https://www.linkedin.com/company/dremio> *Resources for Getting Hands-on with Apache Iceberg/Dremio* <https://medium.com/data-engineering-with-dremio/a-deep-intro-to-apache-iceberg-and-resources-for-learning-more-be51535cff74> On Fri, Jun 14, 2024 at 12:50 PM Dmitri Bourlatchkov <dmitri.bourlatch...@dremio.com.invalid> wrote: > And "soon" is realized by this PR :) > https://github.com/projectnessie/nessie/pull/7043 > > On Fri, Jun 14, 2024 at 12:46 PM Dmitri Bourlatchkov < > dmitri.bourlatch...@dremio.com> wrote: > >> Not sure if there were any other announcements but the Project Nessie >> site has this >> https://projectnessie.org/blog/2024/05/13/nessie-integration-of-iceberg-rest/ >> >> Cheers, >> Dmitri. >> >> On Fri, Jun 14, 2024 at 12:43 PM Ryan Blue <b...@tabular.io> wrote: >> >>> JB, do you have a link to the announcement? I heard that it was planned >>> but wasn't able to find one so I didn't include it. >>> >>> On Thu, Jun 13, 2024 at 5:24 PM Renjie Liu <liurenjie2...@gmail.com> >>> wrote: >>> >>>> Rust is moving towards 0.3 release, and this release focuses on reading >>>> support. >>>> >>>> On Fri, Jun 14, 2024 at 03:03 Jean-Baptiste Onofré <j...@nanthrax.net> >>>> wrote: >>>> >>>>> It looks good to me. >>>>> >>>>> As you mentioned some vendor updates, afair Nessie announced Iceberg >>>>> Rest api support. >>>>> >>>>> Thanks >>>>> Regards >>>>> JB >>>>> >>>>> Le mer. 12 juin 2024 à 23:52, Ryan Blue <b...@tabular.io> a écrit : >>>>> >>>>>> Hi everyone, >>>>>> >>>>>> Here's my current draft board report for June. If you have anything >>>>>> to add or update, please reply and I'll amend the report. >>>>>> >>>>>> Thanks, >>>>>> >>>>>> Ryan >>>>>> >>>>>> ## Description: >>>>>> Apache Iceberg is a table format for huge analytic datasets that is >>>>>> designed >>>>>> for high performance and ease of use. >>>>>> >>>>>> ## Project Status: >>>>>> Current project status: Ongoing >>>>>> Issues for the board: None >>>>>> >>>>>> ## Membership Data: >>>>>> Apache Iceberg was founded 2020-05-19 (4 years ago) >>>>>> There are currently 27 committers and 16 PMC members in this project. >>>>>> The Committer-to-PMC ratio is roughly 7:4. >>>>>> >>>>>> Community changes, past quarter: >>>>>> - No new PMC members. Last addition was Szehon Ho on 2023-04-20. >>>>>> - No new committers. Last addition was Renjie Liu on 2024-03-06. >>>>>> >>>>>> ## Project Activity: >>>>>> >>>>>> Releases: >>>>>> - 1.5.1 was released on 2024-04-25 >>>>>> - 1.5.2 was released on 2024-05-09 >>>>>> - PyIceberg 0.6.1 was released on 2024-04-30 >>>>>> >>>>>> PyIceberg: >>>>>> - Contributors are working to release more often >>>>>> - Improved retries for Hive catalog locking >>>>>> - Added register table support for Glue catalogs >>>>>> - Adding metadata table support (snapshots, manifests, etc.) >>>>>> - Working toward 0.7.0 release with partitioned writes and staged >>>>>> table creation >>>>>> >>>>>> Rust: >>>>>> - Implemented projection to support partition-based file pruning >>>>>> - Implemented the inclusive metrics evaluator and predicate pushdown >>>>>> to Parquet >>>>>> - Added Hive catalog support >>>>>> - Improved REST catalog with OAuth2 and custom headers >>>>>> - Added integration with DataFusion >>>>>> >>>>>> Go: >>>>>> - Working toward full expression support; added literals >>>>>> >>>>>> Iceberg Java: >>>>>> - The next Java release, 1.6.0, is targeted for release in June >>>>>> >>>>>> Specs: >>>>>> - Discussions about standardizing metadata for materialized views >>>>>> have made good >>>>>> progress. The community decided to use existing objects rather than >>>>>> creating a >>>>>> new combined table/view object and is working on metadata details. >>>>>> - An extension to the REST protocol for privilege GRANT and REVOKE >>>>>> operations >>>>>> was proposed. >>>>>> - Many discussions for extending the REST protocol are ongoing, >>>>>> including adding >>>>>> routes to plan scans, adding auth decisions, and appending data >>>>>> files >>>>>> - There are also discussions for v3 features, like additional types >>>>>> (variant, >>>>>> timestampns, and others) >>>>>> >>>>>> ## Community Health: >>>>>> >>>>>> The Iceberg community continues to be healthy, with a large number of >>>>>> commits >>>>>> and individual contributors over the past quarter. Although overall >>>>>> commits >>>>>> decreased, the change corresponds with the number of opened PRs so >>>>>> the change is >>>>>> not a concern for health; PRs are getting reviewed. >>>>>> >>>>>> The community is formalizing design discussions and has added github >>>>>> labels and >>>>>> documented a process for making changes to community specs. >>>>>> >>>>>> The community also held the first Iceberg Summit this quarter, with >>>>>> 32 sessions >>>>>> that are now available on the YouTube ( >>>>>> https://tinyurl.com/iceberg-summit). >>>>>> Community members also spoke at CoC EU. >>>>>> >>>>>> A company that employs 3 PMC members and 2 committers was acquired. >>>>>> The PMC >>>>>> members (2 of whom are ASF members) have been reminded to act as >>>>>> individuals, >>>>>> not as representatives of their employer, when interacting in the >>>>>> community. >>>>>> Concentrations of PMC members is a risk that the community is aware >>>>>> of and will >>>>>> note in future board reports. >>>>>> >>>>>> Other projects and announcements: >>>>>> - Trino added support for Iceberg views >>>>>> - Beam has added an Iceberg sink >>>>>> - Confluent, Terradata, and Oracle announced Iceberg support >>>>>> - Snowflake announced a new open source REST catalog project >>>>>> - Databricks released its catalog that implements the REST spec >>>>>> >>>>>> >>>>>> -- >>>>>> Ryan Blue >>>>>> Tabular >>>>>> >>>>> >>> >>> -- >>> Ryan Blue >>> Tabular >>> >>
