Re: [VOTE] Add commit timestamp to CommitReport

Thanks Daniel for your thorough explanation. I understand your concern now and agree with this point. I feel like we're adding additional information that isn't accurate and > doesn't add a whole lot of value. > Actually, maintenance tasks scheduling doesn't require an accurate timestamp, which

Re: [VOTE] Adopt the v3 spec changes

+1 (binding) Thanks to everyone who made it possible! - Anton вт, 20 трав. 2025 р. о 12:59 Talat Uyarer пише: > +1 (non-binding) > > On Tue, May 20, 2025 at 12:44 PM Russell Spitzer < > russell.spit...@gmail.com> wrote: > >> +1 (binding) >> >> On Tue, May 20, 2025 at 11:02 AM Steven Wu wrote:

Re: Discuss proposal - IRC APIs for Multi-Statement Multi-Table Transactions

Appreciate the feedback on the "catalog-authored timestamp" document ! Ryan, I don't think we can get consistent time travel queries in iceberg without fixing the timestamp field since it's what th

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC1

Thank you Kevin for working on this! +1 non-binding - [x] Download links are valid. - [x] Checksums and signatures. - [x] LICENSE/NOTICE files exist - [x] No unexpected binary files - [x] All source files have ASF headers - [x] Can compile from source Tested iceberg and iceberg-rest. On Wed, Ma

Re: Hive 4 support

> Spark can be configured to use a different version It’s not true. IsolatedClassLoader only supports Spark Hive session catalog and Iceberg always uses Spark built-in Hive jars, namely, Hive 2.3.9 for Spark 3.x and Hive 2.3.10 for Spark 4.0 Thanks, Cheng Pan > On May 21, 2025, at 03:06, Den

Re: Discuss proposal - IRC APIs for Multi-Statement Multi-Table Transactions

Thank you Ryan, Maninder and the rest of the community for feedback and ideas! Drew and I will take another pass and remove the catalog co-ordination requirement for LoadTable API, and bring the proposal closer to "catalog-authored timestamp" in the sense that clients can use CSN to find the right

Re: [Discussion] Versioned SQL UDFs (Catalog routines) in Iceberg

Hi folks, We’ve set up a dedicated bi-weekly community sync for the UDF project. Everyone’s welcome to drop in and share ideas! Here is the meeting link: Iceberg UDF sync Monday, June 2 · 9:00 – 10:00am Time zone: America/Los_Angeles Google Meet joining info Video call link: https://meet.google.c

Re: Core changes for Flink Dynamic Iceberg Sink

Max, Can you use the factory methods in Expressions rather than changing visibility? Also, I don’t think that making SchemaUpdate public is a good idea. It has a public interf

Re: Discuss proposal - IRC APIs for Multi-Statement Multi-Table Transactions

Thanks for the proposals! There are things that I think are good about both of them. I think that the catalog-authored timestamps proposal misunderstands the purpose of the timestamp field, but does get right that a monotonically increasing "time" field (really a sequence number) across tables enab

Re: [VOTE] Adopt the v3 spec changes

+1 (non-binding) On Tue, May 20, 2025 at 12:44 PM Russell Spitzer wrote: > +1 (binding) > > On Tue, May 20, 2025 at 11:02 AM Steven Wu wrote: > >> +1 (binding) >> >> On Tue, May 20, 2025 at 5:25 AM Manu Zhang >> wrote: >> >>> +1 (non-binding). Thanks Ryan for driving this and everyone contribu

Re: [VOTE] Adopt the v3 spec changes

+1 (binding) On Tue, May 20, 2025 at 11:02 AM Steven Wu wrote: > +1 (binding) > > On Tue, May 20, 2025 at 5:25 AM Manu Zhang > wrote: > >> +1 (non-binding). Thanks Ryan for driving this and everyone contributing >> to the new features. >> >> Regards, >> Manu >> >> Péter Váry 于2025年5月20日 周二20:14

Re: Hive 4 support

I don't believe continuing to build iceberg-hive-metastore jars for Hive 2 is well justified. Hive 2 is deprecated and has known security vulnerabilities, which should encourage users to upgrade. As you pointed out, Spark can be configured to use a different version, but it's ultimately up to t

Re: [VOTE] Add commit timestamp to CommitReport

Hey Manu, I didn't see a discuss thread on this topic, so I'll add my concerns here. The issue I have is around the fidelity of what we're using as a commit timestamp. I feel like we're adding additional information that isn't accurate and doesn't add a whole lot of value. The metrics already in

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC1

+1 (non-binding) [x] Download links are valid. [x] Checksums and signatures. [x] LICENSE/NOTICE files exist [x] No unexpected binary files [x] All source files have ASF headers [x] Can compile from source Ran `./scripts/verify.py` Tested pyiceberg-core against pyiceberg Best, Kevin Liu On Tue,

Re: Hive 4 support

Denys, As I have mentioned before, Spark uses a built-in version of the Hive metastore (currently 2.3.10), but can be configured to use a different version and be pointed to a path containing Hive metastore jars for the different version. However, the highest Hive version that can be configured fo

Re: Discuss proposal - IRC APIs for Multi-Statement Multi-Table Transactions

Hi everyone, To avoid passing copies of a file around for comments, I put the doc for commit sequence numbers into Google so we can comment on a central copy: https://docs.google.com/document/d/1jr4Ah8oceOmo6fwxG_0II4vKDUHUKScb/edit?usp=sharing&ouid=100239850723655533404&rtpof=true&sd=true Ryan

Re: [VOTE] Adopt the v3 spec changes

+1 (binding) On Tue, May 20, 2025 at 5:25 AM Manu Zhang wrote: > +1 (non-binding). Thanks Ryan for driving this and everyone contributing > to the new features. > > Regards, > Manu > > Péter Váry 于2025年5月20日 周二20:14写道： > >> +1 (binding) >> Well done everyone who was working on this! >> >> Fokko

Re: [VOTE] Adopt the v3 spec changes

+1 (binding) Very excited to reach this milestone! -Dan On Tue, May 20, 2025 at 5:26 AM Manu Zhang wrote: > +1 (non-binding). Thanks Ryan for driving this and everyone contributing > to the new features. > > Regards, > Manu > > Péter Váry 于2025年5月20日 周二20:14写道： > >> +1 (binding) >> Well done e

[VOTE] Release Apache Iceberg Rust 0.5.0 RC1

Hello Apache Iceberg Rust Community, This is a call for a vote to release Apache Iceberg rust version 0.5.0. The tag to be voted on is v0.5.0-rc.1. The release candidate: https://dist.apache.org/repos/dist/dev/iceberg/apache-iceberg-rust-0.5.0-rc.1/ Keys to verify the release candidate: https://

Re: [VOTE] Adopt the v3 spec changes

+1 (non-binding) On Tue, 20 May 2025 at 2:00 PM, Ajantha Bhat wrote: > +1 (non-binding) > > Excited to see Iceberg V3 coming together! > > > - Ajantha > > On Tue, May 20, 2025 at 11:22 AM Christian Thiel < > christian.t.b...@gmail.com> wrote: > >> +1 (non-binding) >> >> Christian >> >> Prashant

Re: [VOTE] Adopt the v3 spec changes

+1 (non-binding). Thanks Ryan for driving this and everyone contributing to the new features. Regards, Manu Péter Váry 于2025年5月20日 周二20:14写道： > +1 (binding) > Well done everyone who was working on this! > > Fokko Driesprong ezt írta (időpont: 2025. máj. 20., K, > 8:49): > >> +1 (binding) >> >>

Re: [VOTE] Adopt the v3 spec changes

+1 (binding) Well done everyone who was working on this! Fokko Driesprong ezt írta (időpont: 2025. máj. 20., K, 8:49): > +1 (binding) > > Huge milestone, thanks for driving this, Ryan! > > Kind regards, > Fokko > > Op di 20 mei 2025 om 08:45 schreef huaxin gao : > >> +1 (non-binding) >> >> On Mo

Re: [VOTE] Release Apache Iceberg 1.9.1 RC0

I believe Aihua's approach is the most reasonable. For now, let's revert the core changes to avoid disrupting existing workflows. I've reviewed the PR and re-executed the failed tests. If we're aligned on this direction, we should merge it into the 1.9.x branch and proceed with releasing version 1

Re: Hive 4 support

Wing Yew, how about Hive 3.x HMS? Is it compatible with Spark 3.x? If yes, why keep support for v2? FYI Hive 2.x has many unresolved security vulnerabilities.