Re: [VOTE] Update the table statistics (puffin stats) spec

2025-07-31 Thread Kevin Liu
The PR (https://github.com/apache/iceberg/pull/13513) has been merged. Thanks everyone. Best, Kevin Liu On Wed, Jul 30, 2025 at 10:35 PM Jean-Baptiste Onofré wrote: > +1 > > Regards > JB > > On Mon, Jul 28, 2025 at 12:38 PM Ajantha Bhat > wrote: > > > > Hi e

Re: [MEETUP] Apache Iceberg™ Community Meetup in Raleigh, NC, August 27

2025-07-31 Thread Kevin Liu
Thanks for driving this, Danica! Great to see more meetups on the east coast. Please let me know if there's anything I can help with. Best, Kevin Liu On Wed, Jul 30, 2025 at 12:59 PM Danica Fine wrote: > Hi all, > > I'm writing to let everyone know that we're bri

Re: [ANNOUNCE] Release Apache Iceberg Rust v0.6.0

2025-07-31 Thread Kevin Liu
Thanks Xuanwo! Super exciting. Can't wait to try the new pyiceberg-core release in pyiceberg. Best, Kevin Liu On Thu, Jul 31, 2025 at 2:16 AM Renjie Liu wrote: > Thanks Xuanwo for driving this release, and thanks everyone for the vote > and verification! > > On Thu, Jul 31

[discuss] make all features of IRC spec available in the IRC reference implementation

2025-07-30 Thread Kevin Liu
c", https://iceberg.apache.org/rest-catalog-spec/ Best, Kevin Liu

Re: [VOTE] Update the table statistics (puffin stats) spec

2025-07-28 Thread Kevin Liu
+1 Great catch. I also did a search for "snapshot-id" in https://iceberg.apache.org/spec/ every other reference is `long` :) Best, Kevin Liu On Mon, Jul 28, 2025 at 3:05 PM Daniel Weeks wrote: > +1, no objection from me > > On Mon, Jul 28, 2025 at 11:39 AM Russell Spitz

Re: [EXTERNAL] Re: [DISCUSS] Iceberg Summit NA 2026 and Iceberg Summit EU 2026 ?

2025-07-28 Thread Kevin Liu
+1 for both NA and EU. I would love to attend both so I'd prefer they be on different days. Also +1 for hybrid. We should definitely keep the virtual days, they were helpful for the overall community to participate. I'm happy to be the MC again as needed :) Best, Kevin Liu On Mon, Ju

Re: [VOTE] Release Apache Iceberg Rust 0.6.0 RC1

2025-07-28 Thread Kevin Liu
Thanks for verifying and voting, Steven. We now have 3 binding votes 🚀 Kurtis has opened a PR to improve the docs around docker and podman https://github.com/apache/iceberg-rust/pull/1553 I'll also try to reproduce the issue with podman locally. Best, Kevin Liu On Mon, Jul 28, 2025 at 10:

Re: [VOTE] Release Apache Iceberg Rust 0.6.0 RC1

2025-07-28 Thread Kevin Liu
lly without the `rc` suffix so that we don't need to rename the artifacts before running the `mv` command. Best, Kevin Liu On Mon, Jul 28, 2025 at 7:13 AM Kurtis Wright wrote: > +1 (non-binding) > > [x] Download links are valid. > [x] Checksums and signatures. > [x] LICENSE/

Re: [Discussion] Versioned SQL UDFs (Catalog routines) in Iceberg

2025-07-27 Thread Kevin Liu
Hi Ajantha, I see that the UDF Sync is scheduled in the "Iceberg Dev Events" calendar for tomorrow 7/28 at 9AM PT. I missed the last one, but i'll be at this one. Best, Kevin Liu On Mon, Jul 14, 2025 at 9:22 AM Ajantha Bhat wrote: > Hey everyone, > > No one joined t

Re: [DISCUSS] Limitation of storing UnknownType in MapType

2025-07-26 Thread Kevin Liu
uot; (extends NestedType <https://github.com/apache/iceberg/blob/360f87326d4ccf67512a0240e529035801d9db2b/api/src/main/java/org/apache/iceberg/types/Types.java#L1001>) just like `ListType` and `MapType`. This will make `unknown` the first primitive type to not be allowed as part of another complex typ

Re: Iceberg 1.10.0 release update - July 1, 2025

2025-07-25 Thread Kevin Liu
ding. 3 doesn't have a PR yet. PR >> for 4 is not associated with the milestone yet. >> >> On Fri, Jul 25, 2025 at 9:02 AM Kevin Liu wrote: >> >>> Thanks everyone for the review. The 2 PRs are both merged. >>> Looks like there's only 1 PR left in the 1.1

Re: [VOTE] Release Apache Iceberg Rust 0.6.0 RC1

2025-07-25 Thread Kevin Liu
Bump! We need just one more binding vote! On Thu, Jul 24, 2025 at 8:18 AM Amogh Jahagirdar <2am...@gmail.com> wrote: > +1 (binding) > > Verified checksums/signatures/LICENSE/NOTICE. Ran make build/test on Linux > x86-64 > > Thanks, > > Amogh Jahagirdar > > On Thu, Jul 24, 2025 at 3:03 AM Renjie

Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

2025-07-25 Thread Kevin Liu
is as well as other FileIOs. We use the "Iceberg Dev Events" calendar <https://iceberg.apache.org/community/#iceberg-community-events> for scheduling if there's interest. Best, Kevin Liu On Fri, Jul 25, 2025 at 7:47 AM Stubbs, Michael wrote: > Hi Iceberg community, > &

Re: Iceberg 1.10.0 release update - July 1, 2025

2025-07-25 Thread Kevin Liu
Thanks everyone for the review. The 2 PRs are both merged. Looks like there's only 1 PR left in the 1.10 milestone <https://github.com/apache/iceberg/milestone/54> :) Best, Kevin Liu On Thu, Jul 24, 2025 at 7:44 PM Manu Zhang wrote: > Thanks Kevin. The first change is not in the

Re: Iceberg 1.10.0 release update - July 1, 2025

2025-07-24 Thread Kevin Liu
the default behavior of `iceberg-rest-fixture` image to align with the general expectation when creating a table in a catalog. Please take a look. I would like to have both of these as part of the 1.10 release. Best, Kevin Liu On Wed, Jul 23, 2025 at 1:31 PM Kevin Liu wrote: > Here are the 3

Re: Iceberg 1.10.0 release update - July 1, 2025

2025-07-23 Thread Kevin Liu
Here are the 3 PRs to add corresponding tests. https://github.com/apache/iceberg/pull/13648 https://github.com/apache/iceberg/pull/13649 https://github.com/apache/iceberg/pull/13650 I've tagged them with the 1.10 milestone, waiting for CI to complete :) Best, Kevin Liu On Wed, Jul 23, 2025

Re: Iceberg 1.10.0 release update - July 1, 2025

2025-07-23 Thread Kevin Liu
ls in the other devlist thread https://lists.apache.org/thread/7x7xcm3y87y81c4grq4nn9gdjd4jm05f Thanks, Kevin Liu On Wed, Jul 23, 2025 at 12:17 PM Steven Wu wrote: > Another update on the release. > > The existing blocker PRs are almost done. > > During today's communit

Re: [discuss] ensure feature consistency across the 3 different spark versions

2025-07-23 Thread Kevin Liu
onding tests. Also, a big thanks to Amogh for helping to verify this. Best, Kevin Liu On Tue, Jul 15, 2025 at 12:12 PM Wing Yew Poon wrote: > Kevin, > > Just a minor clarification: > > I want to point out that Spark 4.0 is in an interesting state right >> now. Spark 4.0

Re: [discuss] pyiceberg 0.10.0 release

2025-07-22 Thread Kevin Liu
ython/milestone/10>. I'm working on addressing those and then we can cut a new release. Best, Kevin Liu On Mon, Jul 21, 2025 at 12:53 PM Kevin Liu wrote: > Hey everyone, > > Thanks for chiming in. I'll take a look at some of the remaining items. My > goal is to get 0.10.

Re: [ANNOUNCE] Welcome Prashant Singh as a new Apache Iceberg Committer

2025-07-22 Thread Kevin Liu
Congratulations, Prashant!! Well deserved. Thanks for all the contributions. :) On Tue, Jul 22, 2025 at 10:17 AM Dmitri Bourlatchkov wrote: > Congratulations, Prashant! > > Cheers, > Dmitri. > > On Tue, Jul 22, 2025 at 1:14 PM Russell Spitzer > wrote: > >> Hey y'all, >> >> I'm glad to announce

Re: [VOTE] Release Apache Iceberg Rust 0.6.0 RC1

2025-07-21 Thread Kevin Liu
x27;s a bug that prevents us from publishing the RC artifact to pypi as pre-release. I added a fix in https://github.com/apache/iceberg-rust/pull/1537 Best, Kevin Liu On Mon, Jul 21, 2025 at 8:51 PM Xuanwo wrote: > Hello, Apache Iceberg Rust Community, > > This is a call for a vote to release A

Re: [DISCUSS] Restructuring Docs side navigation

2025-07-21 Thread Kevin Liu
Thanks for working on the navigation! I've run it locally and it looks great. Like Steven mentioned, we can continue to iterate on the improvements. Happy to help review more changes, I was a bit late on this one :) Best, Kevin Liu On Mon, Jul 21, 2025 at 1:27 PM Steven Wu wrote: > FYI

Re: [discuss] pyiceberg 0.10.0 release

2025-07-21 Thread Kevin Liu
make more and faster releases so the community can try out the new features sooner. Best, Kevin Liu On Wed, Jul 9, 2025 at 3:07 PM Sung Yun wrote: > Hi Kevin, > > Thanks for starting this thread! > > I’d like to add the AuthManager and the support for Custom AuthManager > impl

Re: [Discuss] Iceberg Blog Posts

2025-07-16 Thread Kevin Liu
py to help make this happen! Best, Kevin Liu On Wed, Jul 16, 2025 at 9:03 AM Maximilian Michels wrote: > Hi, > > I noticed that all blog posts on https://iceberg.apache.org/blogs/ are > hosted externally. Would it make sense to publish community posts > directly on the Ice

Re: [VOTE] Release Apache Iceberg 1.9.2 RC0

2025-07-15 Thread Kevin Liu
e to just wait for the 1.10 release or would you like to backport the fix to 1.9.x? Best, Kevin Liu On Mon, Jul 14, 2025 at 7:58 AM Claude Warren, Jr wrote: > I would like to see https://github.com/apache/iceberg/pull/13345 applied > to the 1.9.2 release as it solves a race condition that we

Re: [discuss] ensure feature consistency across the 3 different spark versions

2025-07-15 Thread Kevin Liu
onger as it is the last 3.x release. That makes sense to me. I think we should keep at least 1 of the Spark 3.x versions. Not sure if there's value in keeping both 3.4 and 3.5. Let's start a separate thread to solicit some feedback from the community. Best, Kevin Liu On Fri, Jul 11, 2025

[discuss] ensure feature consistency across the 3 different spark versions

2025-07-10 Thread Kevin Liu
/commits/main/spark/v3.4>, 3.5 <https://github.com/apache/iceberg/commits/main/spark/v3.5>, and 4.0 <https://github.com/apache/iceberg/commits/main/spark/v4.0>. Best, Kevin Liu

Re: [DISCUSS] Proposal for Relative Path Support In Table Spec

2025-07-10 Thread Kevin Liu
Yes it was recorded. Dan or Talat should have the recording. I see there's already a link for the recording associated with the gcal event but I dont have access to it. Best, Kevin Liu On Thu, Jul 10, 2025 at 12:37 PM Anurag Mantripragada wrote: > Hey folks, was the sync recorded? I m

Re: [DISCUSS] Proposal for Relative Path Support In Table Spec

2025-07-07 Thread Kevin Liu
I can see the new event on the dev calendar. [image: Screenshot 2025-07-07 at 12.04.08 PM.png] Subscribe to the "Iceberg Dev Events" calendar here: https://iceberg.apache.org/community/#iceberg-community-events Best, Kevin Liu On Mon, Jul 7, 2025 at 11:38 AM Daniel Weeks wrote:

[announce] iceberg dev syncs are centralized in the "Iceberg Dev Events" calendar

2025-07-02 Thread Kevin Liu
Iceberg related dev events :) Best, Kevin Liu

[discuss] pyiceberg 0.10.0 release

2025-07-02 Thread Kevin Liu
berg-python/compare/pyiceberg-0.9.0...main>, thanks to the amazing community. Fokko has started the 0.10.0 milestone <https://github.com/apache/iceberg-python/milestone/10> on github. Please let me know if there is anything that you would like to see in the new release. Best, Kevin Liu

Re: [DISCUSS] Proposal for Iceberg 1.9.2 Release to Fix Critical REST Client Issue

2025-06-16 Thread Kevin Liu
Hi Prashant, This sounds like a good reason to do a patch release. I'm +1 Do you know if this is also affecting other minor versions? Do we also need to patch 1.8.x? Best, Kevin Liu On Mon, Jun 16, 2025 at 10:30 AM Prashant Singh wrote: > Hey all, > > A couple of users have rec

Help review DuckDB's Iceberg write support

2025-06-16 Thread Kevin Liu
ssues before data is written to the cloud. The codebase is in C++ but the concept should be the same :) Best, Kevin Liu

Re: [DISCUSS] Restructuring Docs side navigation

2025-06-06 Thread Kevin Liu
on documentation, https://lists.apache.org/thread/jnfnf886r4y8q3og668f02pbw8ym7pq6 I'd like to reorganize the tabs on the main site and perhaps add a new "Community" tab. I just created https://github.com/apache/iceberg/issues/13261 so I won't forget again :) Looking forward to t

Re: [DISCUSS] June board report

2025-06-06 Thread Kevin Liu
out meetups, similar to the last board report <https://lists.apache.org/thread/k2lm8kyv58ksn1k2n62rnds75kopfxt4>. Lots of community meetups are happening and expanding to more locations. There's also continued discussion on enabling more meetups on the devlist. Best, Kevin Liu On Fri, J

Re: [DISCUSS] Standardize cross client integration tests

2025-06-06 Thread Kevin Liu
integration tests across its clients. I haven't been able to look further, but he pointed me to https://github.com/apache/arrow/tree/main/dev/archery/archery/integration Looking forward to this! Best, Kevin Liu On Thu, Jun 5, 2025 at 4:56 PM Leon Lin wrote: > Hello all, > > I would l

[ANNOUNCE] Release Apache Iceberg Rust 0.5.1

2025-06-04 Thread Kevin Liu
: https://rust.iceberg.apache.org/ Download Links: https://rust.iceberg.apache.org/download pyiceberg-core pypi: https://pypi.org/project/pyiceberg-core/0.5.1/ Best, Kevin Liu

Re: Unofficial iceberg-rust crates on crates.io

2025-06-04 Thread Kevin Liu
uot;likelihood of confusion" test?" section. Best, Kevin Liu On Wed, Jun 4, 2025 at 4:52 PM Chengxu Bian wrote: > Just to add some context: as far as I know, the owner of the iceberg-rust > crate was involved in the early development of the project. I believe some > code was also

Re: Unofficial iceberg-rust crates on crates.io

2025-06-04 Thread Kevin Liu
updates. Best, Kevin Liu On Wed, Jun 4, 2025 at 3:07 PM Denny Lee wrote: > Hey Kevin, > > Prior to PMC private mailing / ASF trademark, perhaps we can start a > conversation with the iceberg-rust > <https://github.com/JanKaul/iceberg-rust> crate folks? > > It looks lik

Unofficial iceberg-rust crates on crates.io

2025-06-04 Thread Kevin Liu
n. I want to start this thread to raise awareness of the issue and figure out the appropriate path for trademark usage. Let me know if I should forward this to the PMC private mailing list and/or the apache trademark email. Best, Kevin Liu

Re: [VOTE] Release Apache Iceberg Rust 0.5.1 RC1

2025-06-03 Thread Kevin Liu
A quick update on the release. We're seeing an issue publishing to crates.io using Github Action, the secret token required seems to be empty. I opened https://issues.apache.org/jira/browse/INFRA-26882 to coordinate with Apache Infra and set the secret. Best, Kevin Liu On Sat, May 31, 20

Re: [VOTE] Release Apache Iceberg Rust 0.5.1 RC1

2025-05-31 Thread Kevin Liu
binding votes to accept the release candidate as Apache Iceberg Rust v0.5.1. The vote PASSED with 3 +1 binding votes and 6 +1 non-binding votes, no +0 or -1 votes. I will coordinate with a PMC member to complete the release with this RC and send out the official release mail shortly. Best, Kevin Liu

Re: [DISCUSS] Enabling more Meetups

2025-05-30 Thread Kevin Liu
to lower the barriers of entry by helping to clarify some of the requirements and expectations. As always, happy to be a resource here. :) Looking forward to hearing more on this topic! Best, Kevin Liu On Thu, May 29, 2025 at 1:02 PM Ryan Blue wrote: > I agree with Russell here. The goal is

Re: [VOTE] Release Apache Iceberg Rust 0.5.1 RC1

2025-05-30 Thread Kevin Liu
Gentle ping to bump this thread :) We need 1 more binding vote for the release! Best, Kevin Liu On Thu, May 29, 2025 at 10:34 AM Fokko Driesprong wrote: > +1 (binding) > > Checked signatures, checksums, and licenses, and did some checks against > the REST catalog. > > Thanks

Re: [VOTE] Release Apache Iceberg 1.9.1 RC1

2025-05-27 Thread Kevin Liu
+1 (non-binding) - Verified signature, checksum, license. * Build + test passed using Java 17 on M1 * Ran a few examples on Spark * Ran pyiceberg integration tests Best, Kevin Liu On Tue, May 27, 2025 at 7:59 AM karuppayya wrote: > When verifying > <https://iceberg.apache.org/how-t

Re: [VOTE] Release Apache Iceberg Rust 0.5.1 RC1

2025-05-26 Thread Kevin Liu
against pyiceberg Best, Kevin Liu On Mon, May 26, 2025 at 10:08 PM Kevin Liu wrote: > Hello Apache Iceberg Rust Community, > > This is a call for a vote to release Apache Iceberg rust version 0.5.1 > The tag to be voted on is v0.5.1-rc.1 > > The release candidate: > >

[VOTE] Release Apache Iceberg Rust 0.5.1 RC1

2025-05-26 Thread Kevin Liu
candidate: ./scripts/verify.py Note, there was an issue during the release process for 0.5.0 for the rust crates but `pyiceberg-core` was successfully published to pypi. Thus, we yank'ed the 0.5.0 version on pypi and created a new release version. Best, Kevin Liu

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC2

2025-05-26 Thread Kevin Liu
we will be creating a new release, we will need to yank this version from pypi. I will work with someone with the proper permissions to do so. Best, Kevin Liu On Mon, May 26, 2025 at 4:30 PM Kevin Liu wrote: > Hi everyone, > > Thank you for testing, verifying, and voting on 0.5.0 RC

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC2

2025-05-26 Thread Kevin Liu
votes. I will coordinate with a PMC member to complete the release with this RC and send out the official release mail shortly. Best, Kevin Liu On Mon, May 26, 2025 at 11:35 AM Fokko Driesprong wrote: > +1 (binding) > > Thanks for fixing the licenses, Kevin! > > Kind regards, &g

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC2

2025-05-22 Thread Kevin Liu
against pyiceberg Best, Kevin Liu On Thu, May 22, 2025 at 9:56 PM Xuanwo wrote: > Thanks for this great work! > > +1 non-binding > > [x] Download links are valid. > [x] Checksums and signatures. > [x] LICENSE/NOTICE files exist > [x] No unexpected binary files > [x

[VOTE] Release Apache Iceberg Rust 0.5.0 RC2

2025-05-22 Thread Kevin Liu
candidate: ./scripts/verify.py Best, Kevin Liu

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC1

2025-05-22 Thread Kevin Liu
toml files, https://github.com/apache/iceberg-rust/pull/1370 - add new commits to changelog for 0.5.0, https://github.com/apache/iceberg-rust/pull/1371 Thanks for everyone's help! 0.5.0 RC1 is cancelled, I'll start a new RC. Best. Kevin Liu On Thu, May 22, 2025 at 10:06 AM Kevin

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC1

2025-05-22 Thread Kevin Liu
added exceptions for `MPL-2.0` and noted that binary is allowed. See https://github.com/apache/iceberg-rust/blame/aa24cf4ef724104dba589b88731b5d36e2295acb/deny.toml#L33-L38 Best, Kevin Liu On Wed, May 21, 2025 at 11:55 PM Xuanwo wrote: > > I also saw that the script hardcoded a few "ca

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC1

2025-05-21 Thread Kevin Liu
we confirm that these other subdirectories do not need to be included. Best, Kevin Liu On Wed, May 21, 2025 at 8:05 PM Renjie Liu wrote: > Thanks Fokko for this fix, I've merged this pr. > > Hi, Kevin: > > Would you help to create another rc? > > On Thu, May 22, 2025 at

Re: [VOTE][Go] Release Apache Iceberg Go v0.3.0 RC0

2025-05-21 Thread Kevin Liu
for running the release! Best, Kevin Liu On Wed, May 21, 2025 at 8:12 AM Matt Topol wrote: > Hi, > > I would like to propose the following release candidate (RC0) of > Apache Iceberg Go version v0.3.0. > > This release candidate is based on commit: > 8270498f1932bececb5cec

Re: [VOTE] Release Apache Iceberg Rust 0.5.0 RC1

2025-05-20 Thread Kevin Liu
+1 (non-binding) [x] Download links are valid. [x] Checksums and signatures. [x] LICENSE/NOTICE files exist [x] No unexpected binary files [x] All source files have ASF headers [x] Can compile from source Ran `./scripts/verify.py` Tested pyiceberg-core against pyiceberg Best, Kevin Liu On Tue

[VOTE] Release Apache Iceberg Rust 0.5.0 RC1

2025-05-20 Thread Kevin Liu
candidate: ./scripts/verify.py Best, Kevin Liu

Re: [VOTE] Release Apache Iceberg 1.9.1 RC0

2025-05-17 Thread Kevin Liu
+1 (non-binding) - Verified signature, checksum, license. * Build + test passed using Java 17 on M1 * Ran a few examples on Spark * Ran pyiceberg integration tests ( https://github.com/apache/iceberg-python/pull/2011) Best, Kevin Liu On Sat, May 17, 2025 at 10:02 AM Jean-Baptiste Onofré wrote

Re: [discuss] Iceberg Rust 0.5.0 Release

2025-05-14 Thread Kevin Liu
wanted to familiarize myself with the rust release process :) Best, Kevin Liu On Wed, May 14, 2025 at 4:24 AM Xuanwo wrote: > Hello, everyone > > Following our most recent iceberg Rust community sync, we will begin the > release process for version 0.5.0. > > A tracking iss

Re: [Discuss] Iceberg 1.9.1 Release

2025-05-12 Thread Kevin Liu
pache/iceberg/pull/12881> * Build, Core: Let RevAPI compare against 1.9.0 / Fix API breakage around StorageCredential #12930 <https://github.com/apache/iceberg/pull/12930> IMO most of these are "nice to have" as part of 1.9.1. Let me know what you think! Best, Kevin Liu On Mo

Re: [VOTE] Merge details about GZip metadata files to the spec.

2025-05-11 Thread Kevin Liu
eme. We agreed to address expanding the naming convention at a later time. This PR just documents the current implementations. Best, Kevin Liu On Sun, May 11, 2025 at 11:48 AM Micah Kornfield wrote: > This vote is to merge https://github.com/apache/iceberg/pull/12598 which > documents tha

Re: [Announce] Seattle Apache Iceberg Community Meetup 5/6

2025-05-02 Thread Kevin Liu
- Iceberg with Spice: AI Agents at the Edge Talks from the event will also be uploaded to the YouTube channel afterward at https://www.youtube.com/@IcebergMeetup Looking forward to seeing everyone there! Best, Kevin Liu On Fri, Apr 18, 2025 at 9:50 AM Kevin Liu wrote: > Hey folks, > >

Re: [ANNOUNCE] Apache PyIceberg release 0.9.1

2025-04-30 Thread Kevin Liu
Thanks for running the release, Fokko! It's great to see the number of fixes in this patch found and contributed by the community. PyIceberg is really taking off! :) Best, Kevin Liu On Wed, Apr 30, 2025 at 8:30 AM Fokko Driesprong wrote: > I'm pleased to announce the rele

Re: Feathercast: 1.9.0 release

2025-04-28 Thread Kevin Liu
🙌 Awesome!! Please post the link here once the episode is produced :) Best, Kevin Liu On Mon, Apr 28, 2025 at 10:49 AM Ryan Blue wrote: > I'd be happy to chat about 1.9. A lot of implementation for v3 features > went in, including: > * timestamp(9), unknown, and and variant typ

Re: Feathercast: 1.9.0 release

2025-04-28 Thread Kevin Liu
Very cool, I didn't know about this page. Thanks for bringing this up. I would love to see an episode about Iceberg on this. Perhaps from someone driving the 1.9.0 release :) Best, Kevin Liu On Mon, Apr 28, 2025 at 9:34 AM Rich Bowen wrote: > Hey friends. Congrats on the 1.9.0 re

Re: [DISCUSS] Spec update to cover compressed JSON metadata files

2025-04-28 Thread Kevin Liu
xample, can automatically detect compression at the suffix, `.json.gz`, but not the other way around. See https://duckdb.org/docs/stable/data/json/loading_json#parameters Best, Kevin Liu On Sun, Apr 27, 2025 at 11:54 PM Fokko Driesprong wrote: > Hey Micah, > > For some reason, your email en

Re: [VOTE] Release Apache PyIceberg 0.9.1rc1

2025-04-28 Thread Kevin Liu
+1 non-binding I verified * signature, checksum, license * Ran unit and integration tests with python 3.12.9 on M1 Thanks for driving the release, Fokko! Best, Kevin Liu On Sun, Apr 27, 2025 at 7:04 PM Honah J. wrote: > +1 (binding) > > 1. Verified sigs/checksum/license > 2. Ra

Re: [VOTE] Release Apache Iceberg 1.9.0 RC2

2025-04-28 Thread Kevin Liu
Late to the party, this was in my draft :) +1 (non-binding) - Verified signature, checksum, license. * Build + test passed using Java 17 on M1 * Ran a few examples on Spark * Ran pyiceberg integration tests Thanks for running the release, Ajantha! Best, Kevin Liu On Sun, Apr 27, 2025 at 7

Re: [DISCUSS] PyIceberg 0.9.1

2025-04-22 Thread Kevin Liu
ome soon after 0.9.1 :) > > Thanks for going through all the commits! > > Kind regards, > Fokko > > Op vr 18 apr 2025 om 17:55 schreef Kevin Liu : > >> Thanks for raising this Fokko! I went through all the commits since the >> 0.9.0 release >> <https://git

[Announce] Seattle Apache Iceberg Community Meetup 5/6

2025-04-18 Thread Kevin Liu
! Talks from both events will also be uploaded to the YouTube channel afterward: https://www.youtube.com/@IcebergMeetup. Best, Kevin Liu

Re: [DISCUSS] PyIceberg 0.9.1

2025-04-18 Thread Kevin Liu
elease. Best, Kevin Liu On Thu, Apr 17, 2025 at 5:54 AM Fokko Driesprong wrote: > Hi everyone, > > After the 0.9.0 release, we've captured quite a few bugfixes > <https://github.com/apache/iceberg-python/milestone/11>, and it would be > good to do a quick 0.9.1 patc

Re: [VOTE][Go] Release Apache Iceberg Go v0.2.0 RC1

2025-04-04 Thread Kevin Liu
+1 (non-binding) Ran verification script `dev/release/verify_rc.sh 0.2.0 1`. Built and tested with the CLI against pyiceberg's integration tests catalog. Best, Kevin Liu On Thu, Mar 20, 2025 at 10:57 AM Matt Topol wrote: > Hi, > > I would like to propose the following release

Re: [discuss] iceberg-rust 0.5.0 release

2025-03-28 Thread Kevin Liu
7;m happy to be the release manager. I want to see if there are any improvements we can make to the release process, similar to what we did for pyiceberg. Best, Kevin Liu On Fri, Mar 28, 2025 at 1:23 AM Fokko Driesprong wrote: > We already have a milestone > <https://github.com/apache/ic

[discuss] iceberg-rust 0.5.0 release

2025-03-27 Thread Kevin Liu
b.com/apache/iceberg-python/pull/1833>) to test the integration using the pyiceberg-core nightly build. The PR is currently blocked until the next pyiceberg-core release. Let me know what you think! Best, Kevin Liu

Re: [ANNOUNCE] Apache Iceberg Go Release v0.2.0

2025-03-26 Thread Kevin Liu
Woot! Can't wait to see this in action at the Iceberg Summit. Thanks for working on the release. BTW here's the apache distribution for iceberg-go 0.2.0 https://dist.apache.org/repos/dist/release/iceberg/apache-iceberg-go-0.2.0/ Best, Kevin Liu On Wed, Mar 26, 2025 at 12:26 PM Matt To

Re: [VOTE][Go] Release Apache Iceberg Go v0.2.0 RC0

2025-03-19 Thread Kevin Liu
+1 (non-binding) Ran verification script `dev/release/verify_rc.sh 0.2.0 0`. Built and tested examples using the CLI. Best, Kevin Liu On Wed, Mar 19, 2025 at 8:55 AM Matt Topol wrote: > Hi, > > I would like to propose the following release candidate (RC0) of > Apache Iceberg Go ve

Re: [VOTE] Release Apache Iceberg 1.7.2 RC3

2025-03-18 Thread Kevin Liu
+1 (non-binding) Verified signature, checksum, and license. Tested against JDK 17 (`17.0.6-zulu`). Also ran against pyiceberg's integration tests <https://github.com/kevinjqliu/iceberg-python/pull/12>. Thanks for running the release! Best, Kevin Liu On Tue, Mar 18, 2025 at 6:

Re: [DISCUSS] Inconsistency between java implementation and spec about partition-spec and schema in v1 table

2025-03-18 Thread Kevin Liu
ple times on the devlist. It's the general approach the java (reference) implementation has taken. I'm in favor of following this approach in other implementations. In order to fix the invalid table metadata, we'd need to be able to read it first. Best, Kevin Liu On Tue, Mar 1

Re: [DISCUSS] Inconsistency between java implementation and spec about partition-spec and schema in v1 table

2025-03-17 Thread Kevin Liu
pendix E: Format version changes" <https://iceberg.apache.org/spec/#version-2>, under the "Reading v1 metadata for v2" section. Best, Kevin Liu On Mon, Mar 17, 2025 at 7:17 PM Renjie Liu wrote: > Hi: > > We found an inconsistency between java implementation and spec

Re: [VOTE] Release Apache Iceberg 1.7.2 RC2

2025-03-12 Thread Kevin Liu
+1 (non-binding) Verified signature, checksum, and license. Tested against JDK 17 (`17.0.6-zulu`). Thanks for running the release! Best, Kevin Liu On Wed, Mar 12, 2025 at 5:01 AM Péter Váry wrote: > +1 > > checked the signatures and run some tests > > Fokko Driesprong ezt írta

Re: [DISCUSS] March board report

2025-03-12 Thread Kevin Liu
eetup Youtube channel, https://www.youtube.com/@IcebergMeetup Best, Kevin Liu On Tue, Mar 11, 2025 at 2:30 PM Ryan Blue wrote: > Hi everyone, > > It’s time for a board report again. Here’s my current draft. Thanks to Dan > for helping put it together while I’m unexpectedly out of the

Re: [ANNOUNCE] Apache Iceberg Pre-Summit Community Meetup in SF

2025-03-11 Thread Kevin Liu
Amazing! Thanks for putting this together. See you there :) On Mon, Mar 10, 2025 at 3:17 PM Russell Spitzer wrote: > I'm flying in early enough to join as well! > > On Mon, Mar 10, 2025 at 4:38 PM Fokko Driesprong wrote: > >> Nice, thanks for organizing this Sung, and thanks to Bloomberg for >>

Re: [VOTE] Release Apache PyIceberg 0.9.0rc3

2025-03-07 Thread Kevin Liu
Hey Hussein, Sorry for the delay, I wanted to take some time and add some highlights to the release note. We'll publish it today :) Best, Kevin Liu On Wed, Mar 5, 2025 at 5:49 AM Hussein Awala wrote: > Hi Drew, > > It seems that the pyiceberg-0.9.0 tag has not been created, nor

Re: [ANNOUNCE] Apache PyIceberg release 0.9.0

2025-03-06 Thread Kevin Liu
Thanks for being the release manager, Drew! Please check out the 0.9.0 release notes <https://github.com/apache/iceberg-python/releases/tag/pyiceberg-0.9.0> on github to see more about this release. Best, Kevin Liu On Thu, Mar 6, 2025 at 9:05 PM Drew wrote: > I'm pleased t

Re: [VOTE] Release Apache PyIceberg 0.9.0rc3

2025-03-03 Thread Kevin Liu
Woot! Thanks for running the release, Drew! And thanks for verifying, everyone. We'll work on getting the final artifact published. Best, Kevin Liu On Mon, Mar 3, 2025 at 1:32 PM Drew wrote: > Thanks everyone for voting!! > > The 72 hours have passed, and a minimum of 3 binding v

Re: [ANNOUNCE] Apache Iceberg release 1.8.1

2025-02-28 Thread Kevin Liu
Great to see this :) Thanks for running the release! On Fri, Feb 28, 2025 at 12:06 AM Eduard Tudenhöfner < etudenhoef...@apache.org> wrote: > I'm pleased to announce the release of Apache Iceberg 1.8.1! > > Apache Iceberg is an open table format for huge analytic datasets. Iceberg > delivers high

Re: [VOTE] Release Apache PyIceberg 0.9.0rc3

2025-02-26 Thread Kevin Liu
the release manager, Drew! Third time's a charm! :) Best, Kevin Liu On Wed, Feb 26, 2025 at 11:17 AM Drew wrote: > Hi Everyone, > > I propose that we release the following RC as the official PyIceberg 0.9.0 > release. > > A summary of the high level features:

Re: [VOTE] Release Apache PyIceberg 0.9.0rc2

2025-02-25 Thread Kevin Liu
will write to `data//` directory. I created an issue at https://github.com/apache/iceberg-python/issues/1721 and the fix at https://github.com/apache/iceberg-python/pull/1722 I'll follow up and cut a new RC. Thanks, Kevin Liu On Tue, Feb 25, 2025 at 1:43 PM Fokko Driesprong wrote: > +1

Re: [VOTE] Release Apache Iceberg 1.8.1 RC1

2025-02-25 Thread Kevin Liu
7;m also continuing to see the flakey test for `iceberg-core`'s `testConcurrentFastAppends` test. I believe this is a local issue with my machine. Thanks for running the release, Eduard! Best, Kevin Liu On Tue, Feb 25, 2025 at 4:23 AM Jean-Baptiste Onofré wrote: > +1 (non binding

Re: [Announce] Apache Iceberg Community Meetup in SF and Seattle

2025-02-24 Thread Kevin Liu
eral model of Catalog Federation in Apache Polaris - Dennis Huo * Iceberg + Delta: Collaborating Across Table Formats - Kevin Liu For SF, we have a diverse batch of topics, including * Building Iceberg S3Table Support for Daft - Conner Howell * The State of Iceberg Catalogs - Arsham Eslami * Securing

Re: [VOTE] Release Apache PyIceberg 0.9.0rc2

2025-02-24 Thread Kevin Liu
ith Python 3.12.8 on M1 and Orbstack BTW, email for RC1 was not sent because we found an issue right away. More details can be found in this devlist thread, https://lists.apache.org/thread/rr8lcf96jl6079dz6vfkwr5spbvlxzpm Thanks for driving the release, Drew! Best, Kevin Liu On Mon, Feb 24,

Re: [DISCUSS] PyIceberg 0.9.0 release

2025-02-22 Thread Kevin Liu
th the WARNING log line when resolving s3 region, #1705 <https://github.com/apache/iceberg-python/issues/1705>. We have not sent out the email for RC1. I would like to fix this issue first. Please let me know what you think! Best, Kevin Liu On Fri, Feb 21, 2025 at 8:51 AM Kevin Liu wro

Re: [DISCUSS] PyIceberg 0.9.0 release

2025-02-21 Thread Kevin Liu
:) Onwards to 0.9.0 RC! Best, Kevin Liu On Fri, Feb 21, 2025 at 8:13 AM Driesprong, Fokko wrote: > Hey everyone, > > Thanks everyone for being on top of 0.9.0. I've done some testing and found > a few more small improvements > <https://github.com/apache/iceberg-python/pu

Re: [DISCUSS] PyIceberg 0.9.0 release

2025-02-19 Thread Kevin Liu
ssage and throw an error when the table reference is used. For the second and third issue, I think we should push back the removal to the next release since we don't have a good solution yet. Would love to hear what others think about this approach. Please let us know if there are any conce

Re: [DISCUSS] Consolidate docs under Concepts and Project/Terms

2025-02-18 Thread Kevin Liu
uidelines>. In general, the main site is where folks new and old to the project gather. I'm happy to help drive the effort to make it easier to navigate. Best, Kevin Liu On Mon, Feb 17, 2025 at 1:01 AM Fokko Driesprong wrote: > I've left some comments on the PR, thanks for clean

Re: [DISCUSS] PyIceberg 0.9.0 release

2025-02-17 Thread Kevin Liu
hime in here if there are other PRs that you think should be part of this upcoming release. Best, Kevin Liu On Mon, Feb 17, 2025 at 9:35 AM Drew wrote: > Hey Kevin, > > Thanks for kicking this off. It’s exciting to see how much PyIceberg has > been evolving! I’d be happy to take on t

Re: [Discuss] Print un-pretty metadata JSON files without whitespace

2025-02-17 Thread Kevin Liu
+1, json with no whitespace sounds like a reasonable default. But if saving storage space and network is the main goal, then setting `write.metadata.compression-codec` to `gzip` is way more impactful. Perhaps this is a good default on the catalog side when creating new metadata json. Best, Kevin

Re: Remove deprecated table properties

2025-02-17 Thread Kevin Liu
/apache/iceberg/pull/2965 Best, Kevin Liu On Mon, Feb 17, 2025 at 2:06 PM Yufei Gu wrote: > +1 to remove them. > Yufei > > > On Mon, Feb 17, 2025 at 1:26 PM Steve Zhang > wrote: > >> Thanks Fokko for removing deprecated properties! >> >> Just want to highl

[DISCUSS] PyIceberg 0.9.0 release

2025-02-17 Thread Kevin Liu
sion there or share your thoughts in this thread about the upcoming release. Best, Kevin Liu

[Announce] Apache Iceberg Community Meetup in SF and Seattle

2025-02-11 Thread Kevin Liu
ou're interested, you can submit a proposal through the Call for Proposals (CFP) link on the Luma page. Looking forward to seeing you there! Talks from both events will also be uploaded to the YouTube channel afterward: https://www.youtube.com/@IcebergMeetup. Best, Kevin Liu

  1   2   3   >