Hi, Ryan: Some updates for rust part: 1. Reading/writing puffin format are both supported in 0.5.1 2. Initial support for name mapping landed
On Thu, Jun 5, 2025 at 1:02 PM Russell Spitzer <russell.spit...@gmail.com> wrote: > Looking good! > > On Wed, Jun 4, 2025 at 4:21 PM Ryan Blue <rdb...@gmail.com> wrote: > >> Hi everyone, >> >> Here’s my draft of our board report for June. I went through the old >> syncs for highlights, but please reply if you want me to add any more! >> >> Ryan >> Description: >> >> Apache Iceberg is a table format for huge analytic datasets that is >> designed >> for high performance and ease of use. >> Project Status: >> >> Current project status: Ongoing >> Issues for the board: None >> Membership Data: >> >> Apache Iceberg was founded 2020-05-19 (5 years ago) >> There are currently 34 committers and 21 PMC members in this project. >> The Committer-to-PMC ratio is roughly 3:2. >> >> Community changes, past quarter: >> >> - No new PMC members. Last addition was Amogh Jahagirdar on >> 2024-08-12. >> - No new committers. Last addition was Huaxin Gao on 2025-02-06. >> >> Project Activity: >> >> Releases: >> >> - Table spec v3 was adopted on 2025-05-22 >> - Java 1.9.1 was released on 2025-05-28 >> - Java 1.9.0 was released on 2025-04-28 >> - Java 1.7.2 was released on 2025-03-19 >> - PyIceberg 0.9.1 was released on 2025-04-30 >> - Rust 0.5.1 was released on 2025-05-31 >> - Rust 0.5.0 was released on 2025-05-26 >> - Go 0.3.0 was released on 2025-05-29 >> - Go 0.2.0 was released on 2025-03-26 >> >> Table spec: >> >> - v3 of the Iceberg spec was adopted by a community vote! Full >> support for v3 is >> targeted for the upcoming Java 1.10.0 release and other >> implementations are >> adding support. >> - Planning for Iceberg v4 has started, with groups self-organizing >> around >> projects like faster commits, columnar metadata, and relative path >> support >> >> Java: >> >> - Added support for Spark 4.0 >> - Implemented v3 row lineage support in Spark MERGE and UPDATE >> - Added a connector for the BigQuery catalog >> - Added support for Flink 2.0 and removed Flink 1.18 >> - Ongoing work to develop a dynamic Flink sync handles table schema >> changes >> - Added Zookeeper locking for Flink table maintenance >> - Refactored REST catalog client to use AuthManager >> - Added reader/writer for partition stats files >> - Completed the core implementation of Variant type >> >> PyIceberg: >> >> - Exceeded 500,000 downloads in a single day >> - Refactoring OAuth for REST catalogs with an AuthManager, like Java >> - Working on adding optimistic concurrency >> - Added support for decimal backed by int32/int64 >> - Fixed “upsert” with complex types >> >> Rust: >> >> - Adding support for v3 metadata fields and encryption fields >> - Now exports DataFusion table provider to Python bindings >> - Added support to add existing Parquet files >> - Added support for Apache Arrow dictionary type >> - Added support for writing Puffin files >> - Runs sqllogictests using DataFusion >> >> Go: >> >> - Added write and commit support >> - Added support for the Glue catalog >> - Supports REST catalog integration tests >> >> C++: >> >> - Added virtual classes for API concepts: Catalog, Table, file >> readers/writers >> - Added manifest and manifest list structures >> - Added TypeVisitor, support for converting schemas to Avro >> - Added expressions, sort orders, and partition specs >> - Added support for configuration files similar to those used by >> PyIceberg >> >> Community Health: >> >> Health metrics: >> >> - Code contributors increased by 23%, on top of a 20% rise last >> quarter! >> - Most metrics were stable; issues closed dropped due to an outlier >> day >> >> Iceberg Summit 2025 was held April 8th (in person) and 9th (virtual). 62 >> talks >> are now available from the project’s youtube channel. >> https://www.youtube.com/playlist?list=PLkifVhhWtccxMcqWlXXFvjJybisFF7ESh >> >> In the 11 months between Iceberg Summit 2024 and 2025, there were: >> >> - 16 releases across Java, Python, Rust, and Go >> - 250 new contributors >> - 7 new committers >> - 5 new PMC members >> - 1 new language implementation (C++) >> >>
