Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (binding) On Wed, May 14, 2025 at 5:52 PM Anton Okolnychyi wrote: > Hi all, > > I propose the following update to the spec to clarify that writers must > remove any deletion vector that applies to a data file when that data file > is removed from the metadata, as previously brought up by Stev

Re: Discuss proposal - IRC APIs for Multi-Statement Multi-Table Transactions

Hi everyone, Thank you for feedback on the MTT proposal and during community sync. Based on it, Jagdeep and I have iterated on the document and added a second option to use *Catalog CommitSequenceNumbers*. Looking forward to getting more feedback on the proposal, where to add more details or appro

[DISCUSS] Namespace Renames

Hi, I recently opened an Issue proposing that the REST catalog spec could be extended to support renaming namespaces in the same way that tables can be renamed. This means both being able to change the name of an individual namespace, but also being

Spark 4.0/Iceberg Integration Merged – Spark 3.5 Merges Can Resume

Dear all, Thank you so much for your patience and support! The Spark 4.0/Iceberg integration PR has now been merged. You can go ahead and resume normal merging on Spark 3.5. Really appreciate everyone’s help in coordinating this. Huaxin

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (non-binding) Thanks, Steve Zhang > On May 14, 2025, at 8:52 AM, Anton Okolnychyi wrote: > > Hi all, > > I propose the following update to the spec to clarify that writers must > remove any deletion vector that applies to a data file when that data file is > removed from the metadata,

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (binding) Denny Lee ezt írta (időpont: 2025. máj. 14., Sze, 20:29): > +1 (non-binding) > > On Wed, May 14, 2025 at 11:21 AM Szehon Ho > wrote: > >> +1 (binding) >> >> Thanks >> Szehon >> >> On Wed, May 14, 2025 at 10:15 AM Fokko Driesprong >> wrote: >> >>> +1 (binding) >>> >>> Op wo 14 mei

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (non-binding) On Wed, May 14, 2025 at 11:21 AM Szehon Ho wrote: > +1 (binding) > > Thanks > Szehon > > On Wed, May 14, 2025 at 10:15 AM Fokko Driesprong > wrote: > >> +1 (binding) >> >> Op wo 14 mei 2025 om 19:14 schreef Amogh Jahagirdar <2am...@gmail.com>: >> >>> +1 (binding) >>> >>> On Wed

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (binding) Thanks Szehon On Wed, May 14, 2025 at 10:15 AM Fokko Driesprong wrote: > +1 (binding) > > Op wo 14 mei 2025 om 19:14 schreef Amogh Jahagirdar <2am...@gmail.com>: > >> +1 (binding) >> >> On Wed, May 14, 2025 at 11:09 AM Ryan Blue wrote: >> >>> +1 (binding) >>> >>> Thanks, Anton! >>

Kind Request: Could We Please Hold Spark 3.5 Merges Briefly for Spark 4.0/Iceberg Integration?

Dear community, Would it be possible to hold off on merging the Spark 3.5 changes for a few hours, until the Spark 4.0/Iceberg integration PR is in? It would help me avoid repeated rebasing. I really appreciate everyone’s support—thank you! Thanks, Huaxin

Re: [discuss] Iceberg Rust 0.5.0 Release

Thanks for starting this discussion! We've been talking about getting 0.5.0 out for quite some time. There's also this 0.5.0 milestone which tracks the 2 currently opened PRs. I'm happy to help as the release manager. I wanted to familiarize mys

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (binding) On Wed, May 14, 2025 at 11:09 AM Ryan Blue wrote: > +1 (binding) > > Thanks, Anton! > > On Wed, May 14, 2025 at 9:41 AM Yufei Gu wrote: > >> +1 (binding) Thanks Anton! >> Yufei >> >> >> On Wed, May 14, 2025 at 9:36 AM Steven Wu wrote: >> >>> +1 (binding) >>> >>> On Wed, May 14, 20

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (binding) Op wo 14 mei 2025 om 19:14 schreef Amogh Jahagirdar <2am...@gmail.com>: > +1 (binding) > > On Wed, May 14, 2025 at 11:09 AM Ryan Blue wrote: > >> +1 (binding) >> >> Thanks, Anton! >> >> On Wed, May 14, 2025 at 9:41 AM Yufei Gu wrote: >> >>> +1 (binding) Thanks Anton! >>> Yufei >>>

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (binding) Thanks, Anton! On Wed, May 14, 2025 at 9:41 AM Yufei Gu wrote: > +1 (binding) Thanks Anton! > Yufei > > > On Wed, May 14, 2025 at 9:36 AM Steven Wu wrote: > >> +1 (binding) >> >> On Wed, May 14, 2025 at 9:31 AM Akashdeep Gupta < >> gupta.akashde...@gmail.com> wrote: >> >>> +1 (non

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (binding) Thanks Anton! Yufei On Wed, May 14, 2025 at 9:36 AM Steven Wu wrote: > +1 (binding) > > On Wed, May 14, 2025 at 9:31 AM Akashdeep Gupta < > gupta.akashde...@gmail.com> wrote: > >> +1 (non binding) >> >> Regards, >> Akashdeep Gupta >> >> >> On Wed, May 14, 2025 at 9:59 PM Daniel Wee

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (binding) On Wed, May 14, 2025 at 9:31 AM Akashdeep Gupta wrote: > +1 (non binding) > > Regards, > Akashdeep Gupta > > > On Wed, May 14, 2025 at 9:59 PM Daniel Weeks wrote: > >> +1 (binding) >> >> On Wed, May 14, 2025 at 9:02 AM Russell Spitzer < >> russell.spit...@gmail.com> wrote: >> >>> +

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (binding) On Wed, May 14, 2025 at 9:02 AM Russell Spitzer wrote: > +1 (Binding) > > On Wed, May 14, 2025 at 10:52 AM Anton Okolnychyi > wrote: > >> Hi all, >> >> I propose the following update to the spec to clarify that writers must >> remove any deletion vector that applies to a data file

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (non binding) Regards, Akashdeep Gupta On Wed, May 14, 2025 at 9:59 PM Daniel Weeks wrote: > +1 (binding) > > On Wed, May 14, 2025 at 9:02 AM Russell Spitzer > wrote: > >> +1 (Binding) >> >> On Wed, May 14, 2025 at 10:52 AM Anton Okolnychyi >> wrote: >> >>> Hi all, >>> >>> I propose the f

Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (Binding) On Wed, May 14, 2025 at 10:52 AM Anton Okolnychyi wrote: > Hi all, > > I propose the following update to the spec to clarify that writers must > remove any deletion vector that applies to a data file when that data file > is removed from the metadata, as previously brought up by Ste

[VOTE] Clarify writer requirements in the spec to prevent orphan DVs

Hi all, I propose the following update to the spec to clarify that writers must remove any deletion vector that applies to a data file when that data file is removed from the metadata, as previously brought up by Steven on the dev list. https://github.com/apache/iceberg/pull/13042 Please vote in

[discuss] Iceberg Rust 0.5.0 Release

Hello, everyone Following our most recent iceberg Rust community sync, we will begin the release process for version 0.5.0. A tracking issue for this release has been created at https://github.com/apache/iceberg-rust/issues/1325. Welcome to share any comments or concerns regarding this release

Re: [DISCUSS] Pre-Proposal: Improving Merge-On-Read Query Performance With Indexing

Hi All, Thank you for working on this. I wanted to share a reference to the BigQuery implementation (Option 3) as another potential approach, and for inspiration. In this setup, The engine is running periodic merge jo