Re: [Discuss] Iceberg 1.9.1 Release

2025-05-17 Thread Aihua Xu
Is https://github.com/apache/iceberg/pull/12670/ considered introducing a broken change for catalog in 1.9.0? Now the client can send a list of snapshots to the server to remove in TableMetadata class while the server with the old Iceberg library still checks to make sure only a single snapshotId i

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-16 Thread Driesprong, Fokko
Hey Russell, Thanks for driving this. Talking about making the security scanner happy: https://github.com/RussellSpitzer/iceberg/pull/5 JB, let me know if you need any help with the Avro release! Kind regards, Fokko Op vr 16 mei 2025 om 19:39 schreef Russell Spitzer < russell.spit...@gmail.com>

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-16 Thread Fokko Driesprong
Hey Russell, Thanks for driving this. Talking about making the security scanner happy: https://github.com/RussellSpitzer/iceberg/pull/5 JB, let me know if you need any help with the Avro release! Kind regards, Fokko Op vr 16 mei 2025 om 19:56 schreef Driesprong, Fokko : > Hey Russell, > > Than

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-16 Thread Russell Spitzer
Steven explained the Flink issue to me, Flink 2.0 isn't in 1.9.0 so not an issue. On Fri, May 16, 2025 at 12:20 PM Russell Spitzer wrote: > Ok so far of the lists proposed above I only picked 2 fixes that apply > cleanly and (we double checked) > actually apply to 1.9.0. Some of the fixes above

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-16 Thread Russell Spitzer
Ok so far of the lists proposed above I only picked 2 fixes that apply cleanly and (we double checked) actually apply to 1.9.0. Some of the fixes above need other commits which aren't in 1.9.0 so aren't an issue. If anyone else has any other issues let me know. The only one i'm not sure about is

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-13 Thread Jean-Baptiste Onofré
The new Avro release will content security improvement (and only this). So even if not strictly required (as iceberg is not impacted), it would be interesting to have security scanner happy ;) Regards JB Le mar. 13 mai 2025 à 23:24, Péter Váry a écrit : > Do we really want to include a new lib

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-13 Thread Péter Váry
Do we really want to include a new lib version in a maintenance release? In the past, we have seen issues when upgrading libs. Avro is very important, as it is used for metadata files. I would rather not include a new version, unless it is absolutely necessary. On Tue, May 13, 2025, 06:42 Jean-Bap

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-12 Thread Jean-Baptiste Onofré
Hi I did a fix/improvement on Avro. I will propose to do new Avro releases. Maybe worth to include in Iceberg 1.9.1 if the timing is ok. Regards JB Le lun. 12 mai 2025 à 20:03, Russell Spitzer a écrit : > I'd rather we didn't get any "feature" sorts of things in like > * Enable HTTP proxy supp

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-12 Thread Russell Spitzer
I'd rather we didn't get any "feature" sorts of things in like * Enable HTTP proxy support for the client used by REST Catalog #12406 * GCP: Support multiple storage credential prefixes #12881 These seem

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-12 Thread Yufei Gu
Thanks Kevin for the list! That looks good to me. Looking forward to getting these fixes out! Yufei On Mon, May 12, 2025 at 10:19 AM Kevin Liu wrote: > Hi Russell, > > I went through the commits since 1.9.x release, > https://github.com/apache/iceberg/compare/1.9.x...main > > Here are some pos

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-12 Thread Kevin Liu
Hi Russell, I went through the commits since 1.9.x release, https://github.com/apache/iceberg/compare/1.9.x...main Here are some possible candidates for 1.9.1 patch release, * Core: Fix Kryo ser/de with StorageCredential config #12882 * Core: Ensure

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-12 Thread Russell Spitzer
I haven't gotten any other issues for 1.9.1 on the milestone and no one has responded here. I think it's important that we get a version of Iceberg out with a working Version function so I'll start a release today or tomorrow for a vote. On Sat, May 3, 2025 at 1:22 AM Jean-Baptiste Onofré wrote:

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-02 Thread Jean-Baptiste Onofré
Hi Russ Yes, agree. Your PR is good and already merged. I don't have anything blocker for 1.9.1 (still working on source-ids, but definitely not for 1.9.1). Thanks ! Regards JB On Fri, May 2, 2025 at 11:47 PM Russell Spitzer wrote: > > Hey y'all! > > Thanks to @suilis we have learned that Iceb

[Discuss] Iceberg 1.9.1 Release

2025-05-02 Thread Russell Spitzer
Hey y'all! Thanks to @suilis we have learned that IcebergBuild.version() is returning unspecified for Iceberg 1.9.0. I have a PR up to fix this and I think this is a clear reason to do a 1.9.1 as soon a