Hi Iceberg Community, Here are the minutes and recording from our Iceberg Sync that took place on *November 9th*.
Always remember, anyone can join the discussion so feel free to share the Iceberg-Sync <https://groups.google.com/g/iceberg-sync> google group with anyone seeking an invite. The notes and the agenda are posted in the Iceberg Sync doc <https://docs.google.com/document/d/1YuGhUdukLP5gGiqCbk0A5_Wifqe2CZWgOd3TbhY3UQg/edit?usp=drive_web> that's also attached to the meeting invitation and it's an excellent place to add items as you see fit so we can discuss them in the following community sync. Meeting Recording <https://drive.google.com/file/d/1KhTR4nc6Q1ZC4BSC3cCvdzjzCutBjfaK/view?usp=sharing> ⭕ - *Highlights* - Python: Added manifest evaluator and column selection (Thanks, Fokko!) - Python: Added SSL support to REST client (Thanks, Dhruv!) - Spark: Aggregate expressions were added (Thanks, Huaxin!) - Flink: 1.16 support was added, 1.13 removed (Thanks, Hililiwei!) - Core: Added changelog table and new scan class (Thanks, Anton!) - Core: Added support for append/delete to branches (Thanks, Amogh!) - Core: Improved snapshot expiration (Thanks Szehon and Amogh!) - Format: Added file sequence number (Thanks, Anton!) - *Releases* - Iceberg 1.1.0 release - https://github.com/apache/iceberg/issues/6162 - *Bugs/Issues* <https://github.com/apache/iceberg/issues> (anything noteworthy that should be addressed/looked at?) - https://github.com/apache/iceberg/pull/5860 - Release version issue if we create a release tag from side branch instead of master. - https://github.com/apache/iceberg/pull/6102 - Statistics file spec change (computed snapshot id to used snapshot id)? Do we need to integrate it to spark engine to have clear idea? - https://github.com/apache/iceberg/pull/6090 - Add delete file information to partitions table? - https://github.com/apache/iceberg/issues/6042 - Bulk table migration. Can I introduce a flag in catalog to block commits when it is enabled? - https://github.com/apache/iceberg/pull/5492 - *Discussion* - Good to see Iceberg View implementation is making progress. Any tentative timeline for the view release? - *Other topics* - Changelog scan updates? - Support for changelog table in v1 is in - V2 tables are not supported yet – can’t plan yet but API exists - Branch writes/reads - https://github.com/apache/iceberg/pull/5150 - How often do we expect next 1.x releases to go out? -> GOAL: every 4-6 weeks Thanks everyone!
