Re: Unofficial iceberg-rust crates on crates.io

2025-06-05 Thread Renjie Liu
Hi: The author JanKaul was an early contributor of iceberg-rust, and for the reasons mentioned in above issues he still keeps maintaining his own repo. We also had a discussion about this problem in slack: https://apache-iceberg.slack.com/archives/C05HTENMJG4/p1720240171913639 , in summary the co

Re: [DISCUSS] June board report

2025-06-05 Thread Renjie Liu
Hi, Ryan: Some updates for rust part: 1. Reading/writing puffin format are both supported in 0.5.1 2. Initial support for name mapping landed On Thu, Jun 5, 2025 at 1:02 PM Russell Spitzer wrote: > Looking good! > > On Wed, Jun 4, 2025 at 4:21 PM Ryan Blue wrote: > >> Hi everyone, >> >> Here’

Re: [DISCUSS] Restructuring Docs side navigation

2025-06-05 Thread Eduard Tudenhöfner
I do agree that we need to restructure the site to make things less cluttered and easier to find. Thanks Manu/Peter for working on this. It would be great to have a few more reviewers that can help out here and add their opinions about the restructure. Thanks Eduard On Thu, Jun 5, 2025 at 3:26 AM

Re: Wide tables in V4

2025-06-05 Thread Péter Váry
For the record, link from a user requesting this feature: https://github.com/apache/iceberg/issues/11634 On Mon, Jun 2, 2025, 12:34 Péter Váry wrote: > Hi Bart, > > Thanks for your answer! > I’ve pulled out some text from your thorough and well-organized response > to make it easier to highlight

[DISCUSS] Standardize cross client integration tests

2025-06-05 Thread Leon Lin
Hello all, I would like to start a discussion on standardizing the cross client integration testing in iceberg projects. With all the active development among the different client implementations (python, rust, go, etc), it will be important to make sure the implementations are interoperable betwe

Re: [DISCUSS] v4 - One file commits

2025-06-05 Thread Anurag Mantripragada
We have been hitting all the metadata problems you mentioned, Ryan. I’m on-board to help however I can to improve this area. ~ Anurag Mantripragada > On Jun 3, 2025, at 2:22 AM, Huang-Hsiang Cheng > wrote: > > I am interested in this idea and looking forward to collaboration. > > Thanks, >

Re: [DISCUSS] June board report

2025-06-05 Thread Jean-Baptiste Onofré
Hi Ryan It looks good to me. Thanks ! Nit: In terms of number, according to the record, the 34 committers include the PMC members, meaning that Iceberg has 13 committers (not PMC member). The board report tool (old one) should be clearer about that. Regards JB Le mer. 4 juin 2025 à 16:20, Ryan

Re: Unofficial iceberg-rust crates on crates.io

2025-06-05 Thread Jean-Baptiste Onofré
Hi Kevin Thanks for your message and let’s the community know. I would propose to contact iceberg-rust maintainers to see the purpose and if they are kindly accepting to revisit this. Regards JB Le mer. 4 juin 2025 à 14:59, Kevin Liu a écrit : > Hi everyone, > > I was working on the iceberg-r

Re: [DISCUSS] June board report

2025-06-05 Thread Ryan Blue
JB, is there a new report tool? I just use the numbers that are generated by the tool for consistency. On Thu, Jun 5, 2025 at 8:03 AM Jean-Baptiste Onofré wrote: > Hi Ryan > > It looks good to me. Thanks ! > > Nit: In terms of number, according to the record, the 34 committers > include the PMC

Re: [DISCUSS] v4 - Improved column statistics

2025-06-05 Thread Ryan Blue
> I think it does not make sense to stick manifest files to Avro if we break column stats into sub fields. This isn't necessarily true. Avro can benefit from better pushdown with Eduard's approach as well by being able to skip more efficiently. With the current layout, Avro stores a list of key/va

Re: [DISCUSS] v4 - Improved column statistics

2025-06-05 Thread John Zhuge
+1 Looking forward to this feature John Zhuge On Thu, Jun 5, 2025 at 2:22 PM Ryan Blue wrote: > > I think it does not make sense to stick manifest files to Avro if we > break column stats into sub fields. > > This isn't necessarily true. Avro can benefit from better pushdown with > Eduard's ap

Re: [ANNOUNCE] Release Apache Iceberg Rust 0.5.1

2025-06-05 Thread Renjie Liu
Thanks Kevin for driving this release! On Thu, Jun 5, 2025 at 1:30 PM Kevin Liu wrote: > Hi all, > > The Apache Iceberg Rust community is pleased to announce that Apache > Iceberg Rust 0.5.1 has been released! This also includes the release of > pyiceberg-core 0.5.1, which is the rust bindings f