Hey Iceberg Nation, Here are the meeting minutes from the July 31st meeting. The three more recent meeting minutes are about to follow! JB, they are official now ;)
Transcription/Recording https://youtu.be/bN8OSHPApSk Summary 0:00 New Committers and PMC Members @ 0:00 Welcomed several new Committers and PMC members, including Hona, Sun, Kevin, Sean, Renjie, and Piotr. 1:53 Iceberg 1.6 Release @ 1:53 This release adds Avro CVE fixes and a memory fix contributed by new committer Piotr. There was also discussion around the timing of the 1.7 release and the possibility of an earlier release to get some key updates out sooner. 22:07 Other Updates @ 22:07 - Improvements to Flink support, including limit pushdown and speculative execution - Progress on Python, Rust, and Go implementations - Upcoming changes to the Iceberg catalog sync meeting schedule 25:48 Iceberg Format Version 3 (V3) @ 25:48 Here are the key roadmap items for Iceberg Format Version 3 (V3): - What features should be included in V3 (e.g. timestamp nanos, variants, null type, type promotion, default values) - Whether to tie the V3 release to a specific Iceberg version or keep them decoupled - Ensuring the V3 spec is implementable across languages, not just the Java reference implementation - Formalizing more table properties and configuration values in the spec 55:15 Next Steps @ 55:15 The group agreed to continue the discussion around Iceberg Format V3 on the dev mailing list, with the goal of defining a clear roadmap and getting commitments from contributors to drive key features to completion. The team will also work on improving the tracking and management of the V3 spec changes. Notes * Highlights * Welcome new committers and PMC members! * Java * Iceberg 1.6.0 has been released! Thanks JB!! 🎉🎉🎉 * [Core: Support appending files with different partition specs]( https://github.com/apache/iceberg/pull/9860) (Farooq Qaiser) * Flink added limit pushdown for FLIP-27 source (Thanks, Steven!) * Added Flink speculative execution support (Thanks, Venkata!) * Kafka Connect now has a runtime distribution (Thanks, Bryan!) * Updated ParallelIterable to limit memory consumption (Thanks, Piotr!) * Python * [PyIceberg 0.7.0 has been released]( https://lists.apache.org/thread/93p74trcg8wh0qwhdcc120v10wfnwpb1)! Thanks Sung!! 🎉🎉🎉 * Rust * [Avro-rs release, waiting on a final binding vote]( https://lists.apache.org/thread/tqj0zk7qqsgr6tw10247grz3dv3svhtn) * [Add in-memory catalog implementation]( https://github.com/apache/iceberg-rust/pull/475) (Farooq Qaiser) * Go * [Boolean expression visitors]( https://github.com/apache/iceberg-go/pull/108), thanks Matt * Releases * 1.6.1 release * Bugs that should be fixed? * Avro CVE * 1.7.0 timeline and release manager * Russell volunteering to be RM * LICENSE and NOTICE for kafka connect runtime * KC runtime Jar! * Discussion * Short items: * LICENSE and NOTICE - opportunity for new contributors * Kafka Connect status * REST catalog sync * Should [format-version=3]( https://github.com/apache/iceberg/blob/apache-iceberg-1.6.0/format/spec.md?plain=1#L1290-L1315) become formally adopted in Iceberg 1.7.0? * Interest in releasing [new column type]( https://github.com/apache/iceberg/issues/10775). * [Default values](https://github.com/apache/iceberg/pull/2496) and [timestamp_ns](https://github.com/apache/iceberg/pull/9008) appear to be ready. * [Multi-arg transforms](https://github.com/apache/iceberg/issues/8258) would be deferred to format-version=4 * [Namespace separator 0x1f]( https://github.com/apache/iceberg/issues/10338)
