Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (non-binding) On Thu, May 15, 2025 at 5:40 PM Jean-Baptiste Onofré wrote: > +1 (non binding) > > Regards > JB > > Le mer. 14 mai 2025 à 17:52, Anton Okolnychyi a > écrit : > >> Hi all, >> >> I propose the following update to the spec to clarify that writers must >> remove any deletion vector

Re: [discuss] Iceberg Rust 0.5.0 Release

Thanks Xuanwo for raising this, I think we have resolved all blockers for 0.5.0 milestone, so it would be a great time to have a release! On Thu, May 15, 2025 at 6:15 PM Fokko Driesprong wrote: > Hey Xuanwo, > > Thanks for raising this, and I agree that it's time for another release. > > I've be

Re: Spark 4.0/Iceberg Integration Merged – Spark 3.5 Merges Can Resume

I agree, thank you for working on this! It's great to have this merged. On Thu, May 15, 2025 at 7:47 AM Russell Spitzer wrote: > Thanks for getting this in! > > On Wed, May 14, 2025 at 5:39 PM huaxin gao wrote: > >> Dear all, >> >> Thank you so much for your patience and support! >> >> The Spar

Re: [VOTE] File Format API

I definitely support introducing an API for this purpose and I think that the current work is the right direction. But I'm not sure that a vote is the right next step. A vote should be used to confirm consensus on a design and direction, and I thought the next steps were to build that consensus aro

Re: Spark 4.0/Iceberg Integration Merged – Spark 3.5 Merges Can Resume

Thanks for getting this in! On Wed, May 14, 2025 at 5:39 PM huaxin gao wrote: > Dear all, > > Thank you so much for your patience and support! > > The Spark 4.0/Iceberg integration PR has now been merged. You can go ahead > and resume normal merging on Spark 3.5. > > Really appreciate everyone’s

[VOTE] File Format API

Hi Team, We started the discussion of the File Format API proposal [1] a long time ago [2]. Since then - during the review process - we moved from single formalization of the similar APIs to bigger changes. The lucky ones could see a presentation about the results during the Iceberg Summit [3]. Th

Re: [discuss] Iceberg Rust 0.5.0 Release

Hey Xuanwo, Thanks for raising this, and I agree that it's time for another release. I've been working on using the Iceberg-Rust Avro readers in PyIceberg . A few have already chimed in, but it would be awesome to sneak this into 0.5.0. Kind rega

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (non binding) Regards JB Le mer. 14 mai 2025 à 17:52, Anton Okolnychyi a écrit : > Hi all, > > I propose the following update to the spec to clarify that writers must > remove any deletion vector that applies to a data file when that data file > is removed from the metadata, as previously br