Re: [VOTE] Release Apache Iceberg 1.7.0 RC1

2024-11-05 Thread Jean-Baptiste Onofré
+1 (non binding) I checked: - Parquet has been updated - the planned Avro readers used in both Flink and Spark, they are actually used - Signature and hash are good - No binary file found in the source distribution - ASF header is present in all expected file - LICENSE and NOTICE look good - Build

Re: [DISCUSS] - Deprecate Equality Deletes

2024-11-05 Thread Bryan Keller
I also feel we should keep equality deletes until we have an alternative solution for streaming updates/deletes. -Bryan > On Nov 4, 2024, at 8:33 AM, Péter Váry wrote: > > Well, it seems like I'm a little late, so most of the arguments are voiced. > > I agree that we should not deprecate the

Re: [DISCUSS] Partial Metadata Loading

2024-11-05 Thread Szehon Ho
There seems to be many opinions here, but one of the main objections seems to be the complexity added to REST spec impeding newer catalogs. Looking through the actual REST API change proposal

Re: [VOTE] Release Apache Iceberg 1.7.0 RC1

2024-11-05 Thread Yufei Gu
+1 (binding) Verified signature, checksum, license, build. Successfully tested the following Spark SQL commands on Polaris, using Spark 3.5.3 with the binary artifacts Iceberg 1.7.0 jar. All operations worked as expected. create database db1; show databases; create table db1.t1 (id int, name st

Re: [DISCUSS] Partial Metadata Loading

2024-11-05 Thread Jean-Baptiste Onofré
Hi Szehon I agree with you there. I think it's better to move forward step by step, so Eduard's proposal is a good idea. However, I think it's worth to keep the discussion going, at least to shape a good proposal. Regards JB On Wed, Nov 6, 2024 at 3:23 AM Szehon Ho wrote: > > There seems to b