Re: [DISCUSS] - Deprecate Equality Deletes

Hi Imran, I don't think it's a good idea to start creating multiple types of Iceberg tables. Iceberg's main selling point is compatibility between engines. If we don't have readers and writers for all types of tables, then we remove compatibility from the equation and engine specific formats alway

Re: [VOTE] Release Apache PyIceberg 0.8.0rc1

+1 (non-binding) - verified signature and checksum - verified RAT license check - ran install, tests, and integration tests in python 3.11 Looks good! - Drew On Thu, Nov 7, 2024 at 9:31 PM Sung Yun wrote: > Hi Kevin, > > Thank you for running this release! > > It's a +1 from me. > > I've insta

Re: [DISCUSS] - Deprecate Equality Deletes

I'm not down in the weeds at all myself on implementation details, so forgive me if I'm wrong about the details here. I can see all the viewpoints -- both that equality deletes enable some use cases, but also make others far more difficult. What surprised me the most is that Iceberg does not prov

Re: [DISCUSS] Add a implementation status page for iceberg

Love the idea! On Fri, Nov 8, 2024 at 10:02 AM Yufei Gu wrote: > +1 looking forward to it. One minor suggestion: adding a table spec > version label along with the feature in the support matrix. That doesn't > apply to REST spec though. > > Yufei > > > On Fri, Nov 8, 2024 at 9:31 AM Kevin Liu w

Re: [DISCUSS] Add a implementation status page for iceberg

+1 looking forward to it. One minor suggestion: adding a table spec version label along with the feature in the support matrix. That doesn't apply to REST spec though. Yufei On Fri, Nov 8, 2024 at 9:31 AM Kevin Liu wrote: > Hi Renjie, > > I absolutely love this idea! I wanted to do something s

Re: [DISCUSS][Go] First release of iceberg-go

Oh this looks great! Very well documented. I just went through the release process for PyIceberg. I should have the proper permissions (the KEYS took me a while to set up). Happy to help run these commands :) Best, Kevin Liu On Fri, Nov 8, 2024 at 9:46 AM Matt Topol wrote: > Thanks guys! > > @

Re: [DISCUSS][Go] First release of iceberg-go

Thanks guys! @Kevin: the release process is already all documented at https://github.com/apache/iceberg-go/tree/main/dev/release :) --Matt On Fri, Nov 8, 2024, 6:33 PM Kevin Liu wrote: > Hi Matt, > > Happy to be a reviewer too. I don't know enough about the Go ecosystem to > be a release manag

Re: [DISCUSS][Go] First release of iceberg-go

Hi Matt, Happy to be a reviewer too. I don't know enough about the Go ecosystem to be a release manager. I hope we can document the process for others in the future. Best, Kevin Liu On Fri, Nov 8, 2024 at 6:47 AM Jean-Baptiste Onofré wrote: > Hi Matt > > It sounds good to me. I will be happy t

Re: [DISCUSS] Add a implementation status page for iceberg

Hi Renjie, I absolutely love this idea! I wanted to do something similar while working on the Pyiceberg roadmap. It would make sense to include this for all projects. Some benefits that I see, * Easily and quickly answer questions for "Is X supported in <> project?" * Roadmap for feature parity *

Re: [ANNOUNCE] Apache Iceberg release 1.7.0

Woot! Thank you Russell for driving the release! Best, Kevin Liu On Fri, Nov 8, 2024 at 8:43 AM Russell Spitzer wrote: > Yes that would be part of the docs that I am still in the process of > updating > > On Fri, Nov 8, 2024 at 10:22 AM Rodrigo Meneses > wrote: > >> Thanks so much Russell for

Re: [ANNOUNCE] Apache Iceberg release 1.7.0

Yes that would be part of the docs that I am still in the process of updating On Fri, Nov 8, 2024 at 10:22 AM Rodrigo Meneses wrote: > Thanks so much Russell for driving this. I just checked > https://iceberg.apache.org/releases/ and it looks like the 1.7 release > info is missing from there: >

Re: [ANNOUNCE] Apache Iceberg release 1.7.0

Thanks so much Russell for driving this. I just checked https://iceberg.apache.org/releases/ and it looks like the 1.7 release info is missing from there: Currently it still says "The latest version of Iceberg is 1.6.1 ." On Fri

[ANNOUNCE] Apache Iceberg release 1.7.0

I'm pleased to announce the release of Apache Iceberg 1.7.0! Apache Iceberg is an open table format for huge analytic datasets. Iceberg delivers high query performance for tables with tens of petabytes of data, along with atomic commits, concurrent writes, and SQL-compatible table evolution. This

Re: [DISCUSS][Go] First release of iceberg-go

Hi Matt It sounds good to me. I will be happy to review the first release :) Regards JB On Fri, Nov 8, 2024 at 2:14 PM Matt Topol wrote: > > Hey all, > > With the merging of basic read support [1] among other features, I propose > we've hit a minimum threshold that it makes sense to do a v0.1.

[RESULT][VOTE] Release Apache Iceberg 1.7.0 RC1 - PASS

Hi y'all! This vote has passed: +1 (Binding) : Russell Spitzer Yufei Gu Amogh Jahagirdar Jack Ye Daniel Weeks Eduard Tudenhöfner Fokko Driesprong Péter Váry +1 (Non-Binding): Jean-Baptiste Onofré Prashant Singh Kevin Liu Christian Thiel Aihua Xu I'm going to release right now, keep an eye out fo

Re: [VOTE] Release Apache Iceberg 1.7.0 RC1

Hi y'all! This vote has passed: +1 (Binding) : Russell Spitzer Yufei Gu Amogh Jahagirdar Jack Ye Daniel Weeks Eduard Tudenhöfner Fokko Driesprong Péter Váry +1 (Non-Binding): Jean-Baptiste Onofré Prashant Singh Kevin Liu Christian Thiel Aihua Xu I'm going to release right now, keep an eye out fo

Re: [VOTE] Release Apache Iceberg 1.7.0 RC1

+1 (non-binding) Verified signature, checksums, license Check on Spark with some manual testing Run some unit tests and integration tests on Snowflake Thanks Russell to drive this. Aihua

Re: [DISCUSS] Add a implementation status page for iceberg

Sounds like a great idea to me On Fri, Nov 8, 2024 at 7:58 AM Renjie Liu wrote: > Hi: > > As iceberg evolved to a multi-lang project, I would like to propose to > maintain a status page for iceberg. For more details, please refer to this > doc >

[DISCUSS][Go] First release of iceberg-go

Hey all, With the merging of basic read support [1] among other features, I propose we've hit a minimum threshold that it makes sense to do a v0.1.0 release of the Go implementation of Iceberg. Would anyone be opposed to this idea? Since I'm not a committer, someone else (likely Fokko or Eduard)

[DISCUSS] Add a implementation status page for iceberg

Hi: As iceberg evolved to a multi-lang project, I would like to propose to maintain a status page for iceberg. For more details, please refer to this doc . Welcome to join the discussion and comment o

Re: [VOTE] Iceberg Rust Sync Meeting Time

Thank you, Renjie. I will try my best to attend this event. Looking forward to meet you all. On Fri, Nov 8, 2024, at 19:49, Fokko Driesprong wrote: > Thanks Renjie, > > Looking forward to it! > > Kind regards, > Fokko > > Op vr 8 nov 2024 om 10:48 schreef Renjie Liu : >> Hi, all: >> I've crea

Re: [VOTE] Iceberg Rust Sync Meeting Time

Thanks Renjie, Looking forward to it! Kind regards, Fokko Op vr 8 nov 2024 om 10:48 schreef Renjie Liu : > Hi, all: > I've create a calendar for this: > https://calendar.google.com/calendar/u/0?cid=NzU4MDlhY2YwMTc2NjA2ODQwZjRhZjUxNjk0NjMzNjNlMTFiYzM5NWI3YzI2YmEyZGQxZDRjNjJhZjQyZjFkY0Bncm91cC5jY

Re: Duplicates are getting inserted into Iceberg tables even after de-duplication

I do recall an issue where duplicate data/delete files where possible, but I'm not sure if that's the underlying cause in your case. The issue was fixed by #10007 and was shipped with Iceberg 1.6.0. On Thu, Nov 7, 2024 at 11:12 PM Lewis, William wrot

Re: [VOTE] Iceberg Rust Sync Meeting Time

Hi, all: I've create a calendar for this: https://calendar.google.com/calendar/u/0?cid=NzU4MDlhY2YwMTc2NjA2ODQwZjRhZjUxNjk0NjMzNjNlMTFiYzM5NWI3YzI2YmEyZGQxZDRjNjJhZjQyZjFkY0Bncm91cC5jYWxlbmRhci5nb29nbGUuY29t On Fri, Nov 8, 2024 at 5:10 PM Renjie Liu wrote: > Hi: > > Thanks everyone! > > It seems

Re: [VOTE] Iceberg Rust Sync Meeting Time

Hi: Thanks everyone! It seems that 23:00 to 00:00 GTM+8, last Thursday of each month works for everyone, so let's use this time. I'll send a google calendar event later. On Mon, Oct 28, 2024 at 8:40 PM Fokko Driesprong wrote: > Hey Renjie, > > Thanks for organizing this! Both times are very fr

Re: [VOTE] Release Apache Iceberg 1.7.0 RC1

+1 (non-binding) Ran the Lakekeeper Integration test suite with Spark without problems Thanks! Christian