Hi Ryan, JB and others, Can we please add one more item about Apache Gravitino in the "Other projects and announcements" category, like "Gravitino is donated to the ASF as an incubating project[1] this month that also implements the Apache Iceberg REST spec"? Thanks a lot.
[1] https://lists.apache.org/thread/kh4nc8z3mz7q62l4r42jwg082grl7764 Best regards Jerry Alex Merced <alex.mer...@dremio.com.invalid> 于2024年6月14日周五 10:23写道： > It was announced during the Subsurface keynote and I discuss it in this > blog (if you need something to link to) > > > https://www.dremio.com/blog/the-nessie-ecosystem-and-the-reach-of-git-for-data-for-apache-iceberg/ > > Although some of press may conflate two announcements that came out of > subsurface > > 1. Dremio adding rest catalog as a source support > 2. Nessie adopting rest catalog interface > > (Reading through the press that came out of it most of it is worded > emphasizing announcement #1, so I can see how #2 got lost in the mix) > > *Alex Merced <https://bio.alexmerced.com/data> * > *Senior Tech Evangelist, Dremio **Dremio.com* > <https://www.dremio.com/?utm_medium=email&utm_source=signature&utm_term=na&utm_content=email-signature&utm_campaign=email-signature>*/ > **Follow Us on LinkedIn!* <https://www.linkedin.com/company/dremio> > *Resources for Getting Hands-on with Apache Iceberg/Dremio* > <https://medium.com/data-engineering-with-dremio/a-deep-intro-to-apache-iceberg-and-resources-for-learning-more-be51535cff74> > > > On Fri, Jun 14, 2024 at 12:50 PM Dmitri Bourlatchkov > <dmitri.bourlatch...@dremio.com.invalid> wrote: > >> And "soon" is realized by this PR :) >> https://github.com/projectnessie/nessie/pull/7043 >> >> On Fri, Jun 14, 2024 at 12:46 PM Dmitri Bourlatchkov < >> dmitri.bourlatch...@dremio.com> wrote: >> >>> Not sure if there were any other announcements but the Project Nessie >>> site has this >>> https://projectnessie.org/blog/2024/05/13/nessie-integration-of-iceberg-rest/ >>> >>> Cheers, >>> Dmitri. >>> >>> On Fri, Jun 14, 2024 at 12:43 PM Ryan Blue <b...@tabular.io> wrote: >>> >>>> JB, do you have a link to the announcement? I heard that it was planned >>>> but wasn't able to find one so I didn't include it. >>>> >>>> On Thu, Jun 13, 2024 at 5:24 PM Renjie Liu <liurenjie2...@gmail.com> >>>> wrote: >>>> >>>>> Rust is moving towards 0.3 release, and this release focuses on >>>>> reading support. >>>>> >>>>> On Fri, Jun 14, 2024 at 03:03 Jean-Baptiste Onofré <j...@nanthrax.net> >>>>> wrote: >>>>> >>>>>> It looks good to me. >>>>>> >>>>>> As you mentioned some vendor updates, afair Nessie announced Iceberg >>>>>> Rest api support. >>>>>> >>>>>> Thanks >>>>>> Regards >>>>>> JB >>>>>> >>>>>> Le mer. 12 juin 2024 à 23:52, Ryan Blue <b...@tabular.io> a écrit : >>>>>> >>>>>>> Hi everyone, >>>>>>> >>>>>>> Here's my current draft board report for June. If you have anything >>>>>>> to add or update, please reply and I'll amend the report. >>>>>>> >>>>>>> Thanks, >>>>>>> >>>>>>> Ryan >>>>>>> >>>>>>> ## Description: >>>>>>> Apache Iceberg is a table format for huge analytic datasets that is >>>>>>> designed >>>>>>> for high performance and ease of use. >>>>>>> >>>>>>> ## Project Status: >>>>>>> Current project status: Ongoing >>>>>>> Issues for the board: None >>>>>>> >>>>>>> ## Membership Data: >>>>>>> Apache Iceberg was founded 2020-05-19 (4 years ago) >>>>>>> There are currently 27 committers and 16 PMC members in this project. >>>>>>> The Committer-to-PMC ratio is roughly 7:4. >>>>>>> >>>>>>> Community changes, past quarter: >>>>>>> - No new PMC members. Last addition was Szehon Ho on 2023-04-20. >>>>>>> - No new committers. Last addition was Renjie Liu on 2024-03-06. >>>>>>> >>>>>>> ## Project Activity: >>>>>>> >>>>>>> Releases: >>>>>>> - 1.5.1 was released on 2024-04-25 >>>>>>> - 1.5.2 was released on 2024-05-09 >>>>>>> - PyIceberg 0.6.1 was released on 2024-04-30 >>>>>>> >>>>>>> PyIceberg: >>>>>>> - Contributors are working to release more often >>>>>>> - Improved retries for Hive catalog locking >>>>>>> - Added register table support for Glue catalogs >>>>>>> - Adding metadata table support (snapshots, manifests, etc.) >>>>>>> - Working toward 0.7.0 release with partitioned writes and staged >>>>>>> table creation >>>>>>> >>>>>>> Rust: >>>>>>> - Implemented projection to support partition-based file pruning >>>>>>> - Implemented the inclusive metrics evaluator and predicate pushdown >>>>>>> to Parquet >>>>>>> - Added Hive catalog support >>>>>>> - Improved REST catalog with OAuth2 and custom headers >>>>>>> - Added integration with DataFusion >>>>>>> >>>>>>> Go: >>>>>>> - Working toward full expression support; added literals >>>>>>> >>>>>>> Iceberg Java: >>>>>>> - The next Java release, 1.6.0, is targeted for release in June >>>>>>> >>>>>>> Specs: >>>>>>> - Discussions about standardizing metadata for materialized views >>>>>>> have made good >>>>>>> progress. The community decided to use existing objects rather >>>>>>> than creating a >>>>>>> new combined table/view object and is working on metadata details. >>>>>>> - An extension to the REST protocol for privilege GRANT and REVOKE >>>>>>> operations >>>>>>> was proposed. >>>>>>> - Many discussions for extending the REST protocol are ongoing, >>>>>>> including adding >>>>>>> routes to plan scans, adding auth decisions, and appending data >>>>>>> files >>>>>>> - There are also discussions for v3 features, like additional types >>>>>>> (variant, >>>>>>> timestampns, and others) >>>>>>> >>>>>>> ## Community Health: >>>>>>> >>>>>>> The Iceberg community continues to be healthy, with a large number >>>>>>> of commits >>>>>>> and individual contributors over the past quarter. Although overall >>>>>>> commits >>>>>>> decreased, the change corresponds with the number of opened PRs so >>>>>>> the change is >>>>>>> not a concern for health; PRs are getting reviewed. >>>>>>> >>>>>>> The community is formalizing design discussions and has added github >>>>>>> labels and >>>>>>> documented a process for making changes to community specs. >>>>>>> >>>>>>> The community also held the first Iceberg Summit this quarter, with >>>>>>> 32 sessions >>>>>>> that are now available on the YouTube ( >>>>>>> https://tinyurl.com/iceberg-summit). >>>>>>> Community members also spoke at CoC EU. >>>>>>> >>>>>>> A company that employs 3 PMC members and 2 committers was acquired. >>>>>>> The PMC >>>>>>> members (2 of whom are ASF members) have been reminded to act as >>>>>>> individuals, >>>>>>> not as representatives of their employer, when interacting in the >>>>>>> community. >>>>>>> Concentrations of PMC members is a risk that the community is aware >>>>>>> of and will >>>>>>> note in future board reports. >>>>>>> >>>>>>> Other projects and announcements: >>>>>>> - Trino added support for Iceberg views >>>>>>> - Beam has added an Iceberg sink >>>>>>> - Confluent, Terradata, and Oracle announced Iceberg support >>>>>>> - Snowflake announced a new open source REST catalog project >>>>>>> - Databricks released its catalog that implements the REST spec >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Ryan Blue >>>>>>> Tabular >>>>>>> >>>>>> >>>> >>>> -- >>>> Ryan Blue >>>> Tabular >>>> >>>
