Re: Iceberg python library sync

2025-05-22 Thread Jun H.
Hi everyone, FYI, the next community python library sync meeting will be on Tuesday (05/27/2025) at 9 AM (US/Pacific). Here is the meeting agenda with the topics to discuss: https://docs.google.com/document/d/1oMKodaZJrOJjPfc8PDVAoTdl02eGQKHlhwuggiw7s9U/edit?tab=t.0#bookmark=kix.xse8bx2zq1z6. Plea

[RESULT][VOTE] Merge details about GZip metadata files to the spec.

2025-05-22 Thread Micah Kornfield
The vote passes with 7 Binding +1s and 4 non-binding +1s Could a committer help merge the PR please? Thanks, Micah On Tue, May 13, 2025 at 8:33 PM Renjie Liu wrote: > +1 (binding) > > On Tue, May 13, 2025 at 7:12 AM Brian Hulette wrote: > >> +1 (non-binding) >> >> On Mon, May 12, 2025 at 1:25

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC2

2025-05-22 Thread Kevin Liu
+1 (non-binding) [x] Download links are valid. [x] Checksums and signatures. [x] LICENSE/NOTICE files exist [x] No unexpected binary files [x] All source files have ASF headers [x] Can compile from source Ran `./scripts/verify.py` Built and tested, `make build`, `make test` Tested pyiceberg-core

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC2

2025-05-22 Thread Xuanwo
Thanks for this great work! +1 non-binding [x] Download links are valid. [x] Checksums and signatures. [x] LICENSE/NOTICE files exist [x] No unexpected binary files [x] All source files have ASF headers [x] Can compile from source Check and tested for iceberg and iceberg-rest. On Fri, May 23, 2

[VOTE] Release Apache Iceberg Rust 0.5.0 RC2

2025-05-22 Thread Kevin Liu
Hello Apache Iceberg Rust Community, This is a call for a vote to release Apache Iceberg rust version 0.5.0. The tag to be voted on is v0.5.0-rc.2. The release candidate: https://dist.apache.org/repos/dist/dev/iceberg/apache-iceberg-rust-0.5.0-rc.2/ Keys to verify the release candidate: https://

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC1

2025-05-22 Thread Xuanwo
Nice work! On Fri, May 23, 2025, at 12:53, Kevin Liu wrote: > All the PRs to fix RC1 are merged > - Make dependencies.py generate fail on cargo-deny error, > https://github.com/apache/iceberg-rust/pull/1366 > - Run dependency license check in release script, > https://github.com/apache/iceberg-r

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC1

2025-05-22 Thread Kevin Liu
All the PRs to fix RC1 are merged - Make dependencies.py generate fail on cargo-deny error, https://github.com/apache/iceberg-rust/pull/1366 - Run dependency license check in release script, https://github.com/apache/iceberg-rust/pull/1367 - Make dependencies.py check all subdirectories for cargo t

Re: [VOTE] Adopt the v3 spec changes

2025-05-22 Thread John Zhuge
+1 (non-binding) On Wed, May 21, 2025 at 10:09 AM Brian Hulette wrote: > +1 (non-binding) > > On Wed, May 21, 2025 at 12:56 AM Jean-Baptiste Onofré > wrote: > >> +1 (non binding) >> >> Regards >> JB >> >> On Mon, May 19, 2025 at 11:20 PM Ryan Blue wrote: >> > >> > Hi everyone, >> > >> > With t

[RESULT] [VOTE] Adopt the v3 spec changes

2025-05-22 Thread Ryan Blue
With 26 +1 votes (11 binding) and no -1 or +0 votes, this passes. Thank you, everyone! It is awesome to see the progress that we've made to get all these features ready. Ryan On Wed, May 21, 2025 at 10:10 AM Brian Hulette wrote: > +1 (non-binding) > > On Wed, May 21, 2025 at 12:56 AM Jean-Bapt

Re: Hive 4 support

2025-05-22 Thread Wing Yew Poon
Cheng, You are right that Spark's IsolatedClientLoader is only used by its HiveExternalCatalog. In any case, that only adds to the argument to continue supporting iceberg-hive-metastore on Hive 2. In yesterday's community sync, there seems to be agreement to support publishing iceberg-hive-metastor

Re: [VOTE] [REST SPEC] Add row lineage fields.

2025-05-22 Thread Steven Wu
+1 (binding) On Thu, May 22, 2025 at 3:39 PM Prashant Singh wrote: > Hi All, > I propose an update to the Rest Spec to include the Row lineage fields. As > these need to be passed from server to client for reads, as it is > inferred during planning during server side via inheritance from Manifes

[VOTE] [REST SPEC] Add row lineage fields.

2025-05-22 Thread Prashant Singh
Hi All, I propose an update to the Rest Spec to include the Row lineage fields. As these need to be passed from server to client for reads, as it is inferred during planning during server side via inheritance from Manifest and manifest list and not something client can infer on its own without them

[DISCUSS] Overview of the Table Specification Lifecycle and how to Make Changes

2025-05-22 Thread Russell Spitzer
Hi Y'all, As the community grows I wanted to get some of our tribal knowledge written down and get some consensus on what I think isn't really written down anywhere. Please take a look at let me know if you have any questions or comments. I'm imagining this would go either parallel to Contributing

Re: Should DDL operations always create new snapshots?

2025-05-22 Thread Benny Chow
I like the idea that a schema change introduces a snapshot change. For materialized views, it makes it easier for an engine to check the last refresh state of a dependent table. Another use case would be an engine specific query result cache on a table. In both cases, it's a lot easier for the e

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC1

2025-05-22 Thread Kevin Liu
Thanks for confirming, Xuanwo. I've added the other crates to the script, https://github.com/apache/iceberg-rust/pull/1370 Seems like we're running into a few issues with the license check for the new `iceberg-cli` crate. I'll work through those in the PR above. I've also added two PRs to make the