Re: [ANNOUNCE] Release Apache Iceberg Rust v0.4.0

Thank you for building this release! Really nice gift. On Tue, Dec 24, 2024, at 11:53, Sung Yun wrote: > Hi all, > > The Apache Iceberg Rust community is pleased to announce that Apache > Iceberg Rust v0.4.0 has been released! > > The notable changes since v0.3.0 include: > - Caching parsed Manif

Re: [DISCUSS] Add a implementation status page for iceberg

Thanks Renjie for landing the page and others for the review! Merry Christmas! | -+- A /=\ /\ /\___ _ __ _ __ ____ i/ O \i/ \/ \ / _ \| '__|| '__|\ \ / / /=\ / /\ /\ \| __/| | | |\ \/ /

[ANNOUNCE] Release Apache Iceberg Rust v0.4.0

Hi all, The Apache Iceberg Rust community is pleased to announce that Apache Iceberg Rust v0.4.0 has been released! The notable changes since v0.3.0 include: - Caching parsed Manifests and ManifestLists for performance - Support projection pushdown in Datafusion Iceberg - Utilize row group and ro

Re: [ANNOUNCE] Release Apache Iceberg Rust v0.4.0

Thanks for driving this release! Have a nice holiday! On Tue, Dec 24, 2024 at 1:31 PM Fokko Driesprong wrote: > Thanks for driving this release, Sung, and thanks to everyone who > contributed! > > Kind regards, > Fokko > > Op di 24 dec 2024 om 05:22 schreef Xuanwo : > >> Thank you for building t

Re: [ANNOUNCE] Release Apache Iceberg Rust v0.4.0

Thanks for driving this release, Sung, and thanks to everyone who contributed! Kind regards, Fokko Op di 24 dec 2024 om 05:22 schreef Xuanwo : > Thank you for building this release! > > Really nice gift. > > On Tue, Dec 24, 2024, at 11:53, Sung Yun wrote: > > Hi all, > > > > The Apache Iceberg R

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC3

Thanks Sung Yun for working on this release! +1 non-binding [x] Download links are valid. [x] Checksums and signatures. [x] LICENSE/NOTICE files exist [x] No unexpected binary files [x] All source files have ASF headers [x] Can compile from source (on archlinux x86_64) On Sat, Dec 21, 2024, at 1

Re: Changing default delete file granularity for Spark writes from partition to file scoped

Hey all, it's been a while but I wanted to follow up on this thread in case there were any remaining thoughts on changing the default write granularity in Spark to be file scoped. Given the degenerate amplification case for partition scoped deletes and the additional benefits outlined earlier, I t

RE: [VOTE] Release Apache Iceberg Rust 0.4.0 RC3

+1 non-binding [x] Download links are valid [x] Checksums and signatures [x] LICENSE/NOTICE files exist [x] No unexpected binary files [x] All source files have ASF headers [x] Can compile from source Ran verify.py and make test on macOS M2 with OrbStack. On 2024/12/20 15:13:01 Sung Yun wrote: > He

[Bug] Drop columns referenced in active partition specs

Hey folks, There is a bug when dropping a column that is referenced by older partition specs that has been reported several times(see this ) . Dropping such a column breaks the table. It has an easy repro as seen here

RE: [VOTE] Release Apache Iceberg Rust 0.4.0 RC3

Hi folks, 72 hours have passed and we are still short on 2 binding votes to pass this RC. The current tally is: +1: one binding, 2 non-binding +0: none -1: none Acknowledging that the thread was started right before the weekend of a merry holiday season, the vote will remain open until we have

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC3

+1 binding - Checked signature and checksum - Checked licenses - Ran test suite and verify.py - Did some local testing Thanks for running this release Sung, and anyone who contributed to this release. Very excited to see this next milestone for Iceberg-Rust. Kind regards, Fokko Op m

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC3

Hey Sung, Thanks for the new RC! +1 (non-binding) - [x] Download links are valid - [x] Checksums and signatures - [x] LICENSE/NOTICE files exist - [x] No unexpected binary files - [x] All source files have ASF header - [x] Can compile from source - [x] `./scripts/verify.py` - [x] `make test` on M

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC3

+1 non-binding [x] Download links are valid. [x] Checksums and signatures. [x] Can compile from source [x] Ran tests I also ran our integration test matrix with spark, pyiceberg, trino and starrocks against a Lakekeeber based on the rc. Cross-build for x86_64-unknown-linux-gnu, x86_64-unknown-l

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC3

Hi folks, 72 hours have passed and we have the necessary number of binding votes to accept the release candidate. The result is as follows: +1: 3 binding, 4 non-binding (Renjie, Fokko, Amogh / Xuanwo, Christian, Barron, Kevin) +0: none -1: none I will coordinate with a PMC member to complete

Re: [DISCUSS] Add a implementation status page for iceberg

Hi: Thanks everyone for the review and discussion, we have status page landed: https://iceberg.apache.org/status/ On Fri, Dec 13, 2024 at 11:04 AM Renjie Liu wrote: > Hi: > Sorry for delay, here is the pr: > https://github.com/apache/iceberg/pull/11772 > > The status may be inaccurate, maintain

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC3

+1 (binding) Verified sigs/checksums, license checks, and ran tests. Thanks all, pretty cool to see all the developments in the project! - Amogh Jahagirdar On Mon, Dec 23, 2024 at 2:53 PM Kevin Liu wrote: > Hey Sung, > > Thanks for the new RC! > > +1 (non-binding) > - [x] Download links are v