Hey Iceberg Nation, Here are the minutes from yesterday's meeting. Let's deprecate some catalogs!
-Bits Transcription/Recording: https://www.youtube.com/watch?v=uAQVGd5zV4I * Highlights * Spark: [Added locality executor cache for delete files]( https://github.com/apache/iceberg/pull/9563) (Thanks, Anton!) * Docs: Moved to new docs build (Thanks, Bits!) * REST: Added more documentation on sharing credentials (Thanks, Dan!) * Spark: Added support for delete manifest rewrites (Thanks, Anton!) * Spark: Fixed aggregate pushdown for nested fields (Thanks, Amogh!) * Releases * Iceberg 1.5.0 * PyIceberg 0.6.0 * iceberg-rust 0.2.0 * Discussion * Iceberg Summit * 30 second update: [Nanoseconds feature]( https://github.com/apache/iceberg/issues/8657) will be active again soon * Draft for [Materialized View Spec]( https://docs.google.com/document/d/1UnhldHhe3Grz8JBngwXPA6ZZord1xMedY5ukEhZYF-A/edit?usp=sharing ) * Supported catalogs * Catalog confusion * JDBC/Sql upgrades * Hive table locking in PyIceberg * Flink table maintenance - planning to start working on this feature, any input is welcome * Quick compaction for small files and manifest files * Periodic orphan file removal * Periodic snapshot expiration * Pagination and table planning API support in REST spec * [ https://github.com/apache/iceberg/pull/9660](https://github.com/apache/iceberg/pull/9660): need consensus of pageToken empty value * [ https://github.com/apache/iceberg/pull/9695](https://github.com/apache/iceberg/pull/9695) need consensus around serializing partition tuple values (more details in [ https://github.com/apache/iceberg/pull/9717](https://github.com/apache/iceberg/pull/9717)) * Discuss supporting policy decisions in REST spec * [Issue-9597](https://github.com/apache/iceberg/issues/9597): spec change. Add a new `task-type` field to the file scan task JSON serialization.
