Re: [EXTERNAL] Re: [DISCUSS] Column to Column filtering

2024-10-03 Thread Benny Chow
Assuming the table contained smaller and better correlated files, I think a workaround where you materialized the timestamp difference between two columns could be effective for data file pruning. So if a particular planned departure date was associated with a lot of delays and the table was parti

Re: [DISCUSS] Apache Iceberg 1.7.0 Release Cutoff

2024-10-03 Thread Jean-Baptiste Onofré
Hi Russ As discussed during the community sync, I agree with this plan. In the meantime (as you saw on row lineage doc), I'm working on V3 spec proposals (reviews, PRs, ...). If needed, I can be volunteer as release manager for the 1.7.0 release. Regards JB On Fri, Oct 4, 2024 at 5:55 AM Russe

[DISCUSS] Apache Iceberg 1.7.0 Release Cutoff

2024-10-03 Thread Russell Spitzer
Hi y'all! As discussed at the community sync on Wednesday, October has begun and we are beginning to flesh out the 1.7.0 release as well as the V3 Table Spec. Since we are a little worried that we won't have all of the Spec items we want by the end of October, we discussed that we may want to jus

Bayarea Iceberg meetup in November

2024-10-03 Thread Aihua Xu
Hi community! The Apache Iceberg community is gathering in San Francisco on November 4th. Whether you’re interested in presenting or just want to join us for some networking, you can find the event details and RSVP here: https://lu.ma/fholq6oz . Hope to see you there! Thanks, Aihua

Re: [VOTE] Table v3 spec: Add unknown and new type promotion

2024-10-03 Thread rdb...@gmail.com
With 7 +1 votes and 1 -0, this passes. I'll work with Micah to clarify some of the sections that he pointed out, but I don't think that we need to block moving forward on the overall set of things that are proposed. Thanks, everyone! On Tue, Oct 1, 2024 at 1:49 AM Jean-Baptiste Onofré wrote: > +