Re: [VOTE] Release Apache PyIceberg 0.6.1rc2

+1 (non binding) Downloaded specific commit from the repo, and ran both the Python tests and integration tests. Steps: ``` git clone --depth=1 --branch pyiceberg-0.6.1rc2 g...@github.com: apache/iceberg-python.git python -m venv ./venv source ./venv/bin/activate make install make test make test-i

Re: [VOTE] Release Apache PyIceberg 0.6.1rc3

+1 nonbinding - Checked the signatures, checksums, and licenses. - Ran tests (`make test`, `make test-integration`) I also found this page to be very helpful in learning how to verify a release https://py.iceberg.apache.org/verify-release/ Best, Kevin Liu On Thu, Apr 18, 2024 at 4:14 AM Fokko

Re: [ANNOUNCE] Apache PyIceberg release 0.6.1

Thanks for the release! On Wed, May 1, 2024 at 2:47 AM Fokko Driesprong wrote: > Awesome! Thanks for running this release Honah 🙌 > > Kind regards, > Fokko > > Op wo 1 mei 2024 om 06:48 schreef Honah J. : > >> I'm pleased to announce the release of Apache PyIceberg 0.6.1! >> >> Apache Iceberg is

Seattle Apache Iceberg Meetup

oogle Form <https://docs.google.com/forms/d/1pVwoyk5pNBF-bh7maNbw-V9MKR5w4fp2UJ2MW98_Z1E/edit> Also, join #meetup-seattle slack channel for updates on future events. Cheers, Kevin Liu

Re: Seattle Apache Iceberg Meetup

https://lists.apache.org/thread/tw9bpqyh76vfw7284rooboomhzzx8xnd On Wed, May 8, 2024 at 10:09 AM Kevin Liu wrote: > Hey folks, > > We're starting this community meetup in Seattle, more below. > > > *Seattle Apache Iceberg Meetup *May 15th, 5 PM - 8 PM in the Seattle ar

Re: [VOTE] spec: remove the JSON spec for content file and file scan task sections

+1 (non-binding) Thanks, Kevin Liu On Thu, Jul 11, 2024 at 12:00 PM Szehon Ho wrote: > +1 > > Thanks > Szehon > > On Thu, Jul 11, 2024 at 11:02 AM Daniel Weeks wrote: > >> +1 (binding) >> >> On Thu, Jul 11, 2024 at 10:54 AM Anurag Mantripragada >>

Seattle Apache Iceberg Meetup - July 2024

nts in your local area, please feel free to reach out and I can connect you with the right folks. Cheers, Kevin Liu

Re: [ANNOUNCE] Welcoming new committers and PMC members

4 at 8:06 AM Mehul Batra >>>> wrote: >>>> >>>>> Congratulations Everyone! >>>>> >>>>> On Tue, Jul 23, 2024 at 6:36 PM Fokko Driesprong >>>>> wrote: >>>>> >>>>>> Hi everyone, >>>>>

Re: [ANNOUNCE] Apache PyIceberg release 0.7.0

Woot! Thank you, Sung, for managing the release! I'm very excited about this new version. I want to highlight the many contributors who have improved PyIceberg since the last release. There have been 34 unique contributors (source

Re: [DISCUSS] Use iceberg-rust as pyiceberg file io

> First, we need to establish a workflow that allows us to gradually integrate new features into pyiceberg-core. Additionally, pyiceberg should be able to import and optionally use classes from pyiceberg-core in an additive manner. While developing this workflow, our community will learn how to col

Re: [DISCUSS] PyIceberg 0.7.1 release

test it out. Thanks, Kevin Liu On Fri, Aug 2, 2024 at 11:33 AM Sung Yun wrote: > Hi Fokko, > > That makes sense, thank you for the suggestion! The issue was quite severe > for us that we had to fork the repo and have a fix ourselves in order to > run PyIceberg without our applications g

Re: [DISCUSS] Use iceberg-rust as pyiceberg file io

good litmus test for a well-defined FileIO interface is to introduce nanoarrow <https://arrow.apache.org/nanoarrow/latest/getting-started/python.html> and see what breaks. Thanks, Kevin Liu On Tue, Aug 6, 2024 at 11:21 AM Kevin Liu wrote: > > First, we need to establish a w

Re: [DISCUSS] PyIceberg 0.7.1 release

I'm +1 for getting 0.7.1 out fast with patches. And target Arrow 17.0.0 upgrade as part of the 0.8.0 release. Thanks, Kevin Liu On Tue, Aug 6, 2024 at 11:43 AM Fokko Driesprong wrote: > The issues above sound like patches to me, fixing issues discovered during >> the 0.7.0 relea

Re: [DISCUSS] PyIceberg: Remove optional support for instance-level identifier in Catalog and Table APIs

allowing table identifiers both with and without the catalog name. Then, in a future release, we can completely remove the catalog name. Thanks, Kevin Liu On Wed, Jul 31, 2024 at 2:56 PM Sung Yun wrote: > Today in PyIceberg, we have support for identifier parsing in public APIs > belonging

Re: [DISCUSS] Formalized File IO Properties

eIO specific) * `glue.access-key-id` (Glue Catalog specific) * `client.access-key-id` (Unified) Thanks, Kevin Liu On Wed, Jul 31, 2024 at 10:05 AM Xuanwo wrote: > Thanks you all. I'm going to prepare a proposal PR for this. > > On Fri, Jul 12, 2024, at 10:06, Honah J. wrote: > > H

Re: [VOTE] Release Apache PyIceberg 0.7.1rc1

+1 (non-binding) Verified signatures/checksums/licenses. Ran unit and integration tests. Sidenote, the new Verifying a release instructions work like a charm! On Fri, Aug 9, 2024 at 12:30 PM Sung Yun wrote: > Hi Everyone, > > I propose that we rel

Re: [DISCUSS] How about setup a iceberg meetup in Beijing?

helps! Apache Iceberg Developer Community Meetup Guidelines <https://docs.google.com/document/d/1y87k-8nCMczzORIcsePDu6CWTTO0h9qI67W_go8BmPA/edit> Cheers, Kevin Liu On Sun, Aug 11, 2024 at 5:14 AM Renjie Liu wrote: > +1 > > On Sun, Aug 11, 2024 at 16:53 Junwang Zhao wrote: > >

Re: [VOTE] Release Apache PyIceberg 0.7.1rc2

+1 (non-binding) Verified signatures/checksums/licenses. Ran unit and integration tests. On Thu, Aug 15, 2024 at 2:42 AM Fokko Driesprong wrote: > +1 (binding) > > Thanks Sung for running this 🙌 > > - Validated signatures/checksums/license > - Ran some basic tests (3.10) > > Kind regards, > Fokk

Re: [DISCUSS] Iceberg Rust Sync Meeting

+1 on sync meeting for iceberg rust. I want to get involved and catch up on the recent developments. For reference, here's the doc we've been using for the pyiceberg sync https://docs.google.com/document/d/1oMKodaZJrOJjPfc8PDVAoTdl02eGQKHlhwuggiw7s9U Best, Kevin On Wed, Oct 9, 2024 at 5:30 AM Xua

[Discuss] Replace Hadoop Catalog Examples with JDBC Catalog in Documentation

ue [3] and a PR [4] to address this. Please take a look, and I'd love to hear your thoughts on whether this is a direction we want to pursue. Best, Kevin Liu [1] https://iceberg.apache.org/spark-quickstart/#adding-a-catalog [2] https://iceberg.apache.org/docs/nightly/spark-getting-start

Re: Bayarea Iceberg meetup in November

Excited about this, looking forward to it! Best, Kevin On Thu, Oct 3, 2024 at 6:11 PM Aihua Xu wrote: > Hi community! > > The Apache Iceberg community is gathering in San Francisco on November > 4th. Whether you’re interested in presenting or just want to join us for > some networking, you can

Re: Clarification on DayTransform Result Type

the Spark type, it shows up as date and Spark > correctly displays the value. > > On Mon, Sep 30, 2024 at 9:56 AM Kevin Liu wrote: > >> Thank you both for the insights and context. >> >> As Russell pointed out, the "day partition transform" result is true of

Re: Greater Seattle Iceberg Meetup

Thanks, Jonathan. Looking forward to seeing everyone! Please let us know if you would like to present by filling out this form https://docs.google.com/forms/d/1vic-6nUYbUTsf_WmyQ0kB_7BrSdpT97Rfh2cL3cs2kw/edit Best, Kevin Liu On Fri, Oct 18, 2024 at 4:16 PM Jonathan Leang wrote: > Hi every

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

and guidance on upgrading from one version to another. I’d love to hear everyone’s thoughts on this. Best, Kevin Liu [1] https://github.com/apache/iceberg/pull/11354 [2] https://github.com/apache/iceberg/blob/17f1c4d2205b59c2bd877d4d31bbbef9e90979c5/core/src/main/java/org/apache/iceberg/Snapsho

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

uuid` [2][3] and `Snapshot.summary` [4][5]. Would love to get other people's thoughts on this. Best, Kevin Liu [1] https://github.com/apache/iceberg/pull/11354 [2] https://github.com/apache/iceberg/blob/8e743a5b5209569f84b6bace36e1106c67e1eab3/open-api/rest-catalog-open-api.yaml#L2414 [3] https://ic

Re: [Discuss] Replace Hadoop Catalog Examples with JDBC Catalog in Documentation

ickly prototype while also guiding them toward the REST catalog for production use cases. Looking forward to hearing more from you all. Best, Kevin Liu [1] https://lists.apache.org/thread/xl1cwq7vmnh6zgfd2vck2nq7dfd33ncq On Thu, Oct 10, 2024 at 3:44 AM Eduard Tudenhöfner wrote: >

Re: [DISCUSS] [PyIceberg] Use of asserts to "programming the negative space"

x27;m not sure where we can draw the line between using assert/pre-conditions and using if/raise clauses. Best, Kevin Liu [1] https://github.com/apache/iceberg-python/blob/7cf0c225c3cdb32ac5e390de06b7b0e4fe7de92e/pyiceberg/io/pyarrow.py#L2515-L2518 On Wed, Oct 16, 2024 at 12:02 AM Piotr Findeisen

[DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

ement? Additionally, how should we handle existing `metadata.json` files that were generated without this field? Best, Kevin Liu [1] https://iceberg.apache.org/spec/#table-metadata-and-snapshots [2] https://github.com/apache/iceberg/blob/8e2eb9ac2e33ce4bac8956d4e2f099444d03c0e3/open-api/rest-catalog-open-api

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

pecification to ensure that other operations interact with a compliant table. Perhaps we could permit `SnapshotParser` to read the metadata but enforce the `operation` field at a different location to guarantee the table’s compliance with the specification. Best, Kevin Liu [1] https://github.com

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC0

fy_rc.sh` and also upload the KEYS to https://dist.apache.org/repos/dist/dev/iceberg/KEYS? Best, Kevin Liu On Mon, Nov 11, 2024 at 2:12 PM Matt Topol wrote: > Hi, > > I would like to propose the following release candidate (RC0) of Apache > Iceberg Go version v0.1.0. > > This rele

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC0

BTW for folks verifying this RC, these are the changes I made locally for the `dev/release/verify_rc.sh` script to work. https://github.com/apache/iceberg-go/pull/199/files Best, Kevin Liu On Mon, Nov 11, 2024 at 3:03 PM Kevin Liu wrote: > Hi Matt, > > Thanks for the release candidate

Re: Greater Seattle Iceberg Meetup

cover the overview of the `iceberg-python` project and explore some powerful features that can be integrated into your current data stack. Talks will be recorded and uploaded to YouTube ( https://www.youtube.com/@IcebergMeetup) Best, Kevin Liu On Fri, Oct 18, 2024 at 4:45 PM Kevin Liu wrote:

Re: [DISCUSS][Go] First release of iceberg-go

Oh this looks great! Very well documented. I just went through the release process for PyIceberg. I should have the proper permissions (the KEYS took me a while to set up). Happy to help run these commands :) Best, Kevin Liu On Fri, Nov 8, 2024 at 9:46 AM Matt Topol wrote: > Thanks g

Re: [DISCUSS][Go] First release of iceberg-go

Hi Matt, Happy to be a reviewer too. I don't know enough about the Go ecosystem to be a release manager. I hope we can document the process for others in the future. Best, Kevin Liu On Fri, Nov 8, 2024 at 6:47 AM Jean-Baptiste Onofré wrote: > Hi Matt > > It sounds good to me. I

Re: [DISCUSS] Add a implementation status page for iceberg

d to making this happen! And happy to help in any way. Best, Kevin Liu On Fri, Nov 8, 2024 at 6:33 AM Russell Spitzer wrote: > Sounds like a great idea to me > > On Fri, Nov 8, 2024 at 7:58 AM Renjie Liu wrote: > >> Hi: >> >> As iceberg evolved to a multi-lang pro

Re: [DISCUSS] Duplicate KEYS files

ep.app/search?q=/KEYS&case=true&filter[repo.pattern][0]=iceberg Best, Kevin Liu On Mon, Nov 11, 2024 at 9:45 AM Matt Topol wrote: > +1 (non-binding) for merging, I can update the docs on the iceberg Go > release README after it's done! > > On Mon, Nov 11, 2024, 12:20 PM Yufe

Re: [DISCUSS] Duplicate KEYS files

eberg icebergsvn # fails ``` Best, Kevin Liu [1] https://github.com/apache/iceberg-python/pull/1315/files#diff-4e59fab01a772c9c96d23c5ca8a2cce6e1500a71bdf32ad4cb8bec6319d0bdf0L88 On Mon, Nov 11, 2024 at 5:47 PM Renjie Liu wrote: > +1 (binding) for merging. > > On Tue, Nov 12, 2024 at 1:56 AM Ke

Re: [DISCUSS] Duplicate KEYS files

o edit it by hand. > > On Tue, Nov 12, 2024, at 10:16, Kevin Liu wrote: > > Does anyone know how to edit the KEYS file at > https://downloads.apache.org/iceberg/KEYS? > The previous instruction [1] uses `svn` which doesn't work with the above > URL. > ``` > svn co http

Re: [DISCUSS] Duplicate KEYS files

`downloads`. https://downloads.apache.org/iceberg/KEYS https://dist.apache.org/repos/dist/release/iceberg/KEYS Best, Kevin Liu On Tue, Nov 12, 2024 at 9:02 AM Kevin Liu wrote: > Hey folks, > > As mentioned in the previous email. Here are the references to > `dist/dev/iceberg/KEYS` > https://

Re: [DISCUSS] Duplicate KEYS files

/pull/1315 - iceberg-go https://github.com/apache/iceberg-go/pull/200 - iceberg https://github.com/apache/iceberg/pull/11526 We will probably want to merge and remove the dev KEYS first. Thanks, Kevin Liu On Mon, Nov 11, 2024 at 11:52 PM Jean-Baptiste Onofré wrote: > Hi Fokko > &

Re: [DISCUSS] Duplicate KEYS files

y are the same. ``` ➜ ~ curl -s https://downloads.apache.org/iceberg/KEYS | md5sum 905987ebcc39a70ebcbce89f1939fe26 - ➜ ~ curl -s https://dist.apache.org/repos/dist/release/iceberg/KEYS | md5sum 905987ebcc39a70ebcbce89f1939fe26 - ``` Best, Kevin Liu On Tue, Nov 12, 2024 at 9:36 AM Russell Sp

Re: [DISCUSS] Duplicate KEYS files

re updated https://github.com/search?q=%22dist.apache.org%2Frepos%2Fdist%2Fdev%2Ficeberg%2FKEYS%22+org%3Aapache&type=code I also double-checked that the dev KEYS are removed (had to flush the cache again) https://dist.apache.org/repos/dist/dev/iceberg/KEYS Best, Kevin Liu On Tue, Nov 12, 2024 at 11:3

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC1

ix the issue [3], I've verified using my own forked repo. Sorry for the churn here, I should have tested the previous PR more closely. Best, Kevin Liu [1] https://github.com/apache/iceberg-go/releases/tag/v0.1.0-rc1 [2] https://github.com/apache/iceberg-go/commit/8ca0bb7bdf7868bac4aca83f5

Re: [ANNOUNCE] Apache Iceberg release 1.7.0

Woot! Thank you Russell for driving the release! Best, Kevin Liu On Fri, Nov 8, 2024 at 8:43 AM Russell Spitzer wrote: > Yes that would be part of the docs that I am still in the process of > updating > > On Fri, Nov 8, 2024 at 10:22 AM Rodrigo Meneses > wrote: > >> Th

Re: [VOTE] Drop Python3.8 Support in PyIceberg 0.8.0

+1 non-binding. Thanks for starting this conversation! On Fri, Sep 20, 2024 at 2:02 PM Sung Yun wrote: > Hi folks, > > I'd like to start this thread to vote on dropping the support for > Python3.8 in the upcoming 0.8.0 PyIceberg release. > > Python3.8 will be End-Of-Life in October 2024, and so

Re: [Notice] Update to catalog sync meeting timezone 2

https://docs.google.com/document/d/1iPGVCIcr-M0XtAiudOguWAvmqIdVgpYN5vz5ohO8PKw/edit This doc includes the calendar for the catalog sync and notes from past syncs. Best, Kevin Liu On Tue, Sep 24, 2024 at 8:15 AM Sung Yun wrote: > Hi Jack Ye, thank you for the update ! > > This may b

Clarification on DayTransform Result Type

Hey folks, While reviewing a PR to fix DayTransform in PyIceberg (#1208 ), we found an inconsistency between the spec and the Java Iceberg library. According to the spec , the result type fo

Re: [DISCUSS] Iceberg Summit 2025 ?

+1 to hybrid event with an in-person element. Things I like to see: * Real-world experience from companies running Iceberg at scale * Iceberg catalogs and how it's used * Integrations with open-source projects in the broader ecosystem * Forward-looking statements for the direction of the Iceberg e

Re: Clarification on DayTransform Result Type

d3e3cb15b1712f3a1db473ca940/api/src/main/java/org/apache/iceberg/types/Type.java#L37 >> >> On Thu, Sep 26, 2024 at 8:38 PM Kevin Liu wrote: >> >>> Hey folks, >>> >>> While reviewing a PR to fix DayTransform in PyIceberg (#1208 >>> <https://githu

Re: [VOTE] Release Apache Iceberg 1.7.0 RC1

+1 non-binding Verified signatures, checksums, and license Ran build and tests with JDK17 Best, Kevin Liu On Thu, Nov 7, 2024 at 7:24 AM Prashant Singh wrote: > Thank you Russell ! > > +1 (non-binding) > - Verified signature, checksum, license, build. > - ran our internal s

[VOTE] Release Apache PyIceberg 0.8.0rc1

sting entries when there are deletes - Handle Empty RecordBatch within _task_to_record_batches Please vote in the next 72 hours. [ ] +1 Release this as PyIceberg 0.8.0 [ ] +0 [ ] -1 Do not release this because... Best, Kevin Liu

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

Thanks, Ryan! That makes sense. I want to follow up on the original issue. I've made a PR [1] to enforce that the Snapshot `summary` map must have an `operation` key. Please take a look. Thank you @nastra for the comments and reviews. Best, Kevin Liu [1] https://github.com/apache/iceberg

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

Thanks, everyone! The PR[1] has been merged Best, Kevin Liu [1] https://github.com/apache/iceberg/pull/11354 On Fri, Oct 25, 2024 at 1:02 PM Kevin Liu wrote: > Thanks, Ryan! That makes sense. > > I want to follow up on the original issue. I've made a PR [1] to enforce >

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

2] in the Iceberg repo contains the latest version of the spec. As we're continuing to evolve to spec for V3, would it be helpful to create a frozen version representing both the V1 and V2 specs for reference, possibly as a separate file? Best, Kevin Liu [1] https://github.com/apache/ice

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

pt" : "0", "total-files-size" : "3927895626752", "added-records" : "26508666891", "added-data-files" : "231513", "manifests-replaced" : "0", "total-data-files" :

Re: [DISCUSS] PyIceberg 0.8.1 release

/pull/1369 Please let me know what you think. Best, Kevin Liu On Thu, Nov 21, 2024 at 10:05 AM Kevin Liu wrote: > Thanks for starting this thread! > > Along with the 2 issues listed above, I propose this issue as well > * Ignore tables with missing table_type parameter in HMS an

Re: [ACTION REQUIRED] Removal of v3 artifact actions on December 5th

.pattern][0]=apache/iceberg Only iceberg-python is affected. Here's the PR to update the relevant action, https://github.com/apache/iceberg-python/pull/1371 Best, Kevin Liu On Mon, Nov 25, 2024 at 10:36 AM Jacob Wujciak wrote: > Hello Everyone! > > I am writing to inform you of t

Re: [ACTION REQUIRED] Removal of v3 artifact actions on December 5th

-artifact%40v3&type=code * https://github.com/search?q=org%3Aapache+download-artifact%40v3&type=code Looks like `iceberg-rust` is the only place we missed. Best, Kevin Liu On Wed, Nov 27, 2024 at 5:45 AM Sung Yun wrote: > Hi JB and Kevin, thank you for jumping on the chore. > >

Re: [DISCUSS] iceberg rust 0.4.0 and iceberg pyiceberg_core 0.1.0 release

We'd want to release pyiceberg_core features independent of iceberg-rust features. Please let me know if there's anything I can do to help. Best, Kevin Liu On Wed, Nov 27, 2024 at 6:13 AM Sung Yun wrote: > Hi folks, it's been some time since we've done an Iceberg Rust releas

Re: [Discuss] Document Snapshot Summary Optional Fields for Standardization

cification changes require greater scrutiny. > summary details would not be located near the Snapshot section, which explains the summary field. We can link the table to the Snapshot section. Would love to hear others' thoughts on this. Best, Kevin Liu On Tue, Nov 26, 2024 at 2:50 PM Honah

Re: [VOTE] Release Apache PyIceberg 0.8.1rc1

create a new patch version using `0.8.2`. How does that sound? Additionally, I created a PR to prevent this from happening again. https://github.com/apache/iceberg-python/pull/1386 Best, Kevin Liu On Wed, Nov 27, 2024 at 5:07 PM Sung Yun wrote: > Hi Kevin, > > Thank you so much for w

[VOTE] Release Apache PyIceberg 0.8.1rc1

Release this as PyIceberg 0.8.1 [ ] +0 [ ] -1 Do not release this because... Best, Kevin Liu

Re: [VOTE] Release Apache PyIceberg 0.8.0rc2

PyIceberg 0.8.0. Thanks everyone, when all artifacts are published the announcement will be sent out. Best, Kevin Liu On Mon, Nov 18, 2024 at 10:07 AM Daniel Weeks wrote: > +1 (binding) > > Verified sigs/sums/license/tests+s3 (Python 3.11.9) > > -Dan > > On Sat, Nov 16, 2024

[ANNOUNCE] Apache PyIceberg release 0.8.0

table evolution. This Python release can be downloaded from: https://pypi.org/project/pyiceberg/0.8.0/ Thanks to everyone for contributing! Best, Kevin Liu

Re: [ANNOUNCE] Apache Iceberg Go release v0.1.0

Excited to see the first official release of the Apache Iceberg Go library! Thanks everyone for contributing! And thanks Matt & Fokko for working on the release. Cheers, Kevin Liu On Mon, Nov 18, 2024 at 11:10 AM Matt Topol wrote: > Hi everyone, > > I'm pleased to annou

Re: [DISCUSS] Deprecate embedded manifests

+1 On Tue, Nov 19, 2024 at 9:23 AM Bryan Keller wrote: > +1 to deprecate > > On Nov 19, 2024, at 3:32 AM, Fokko Driesprong wrote: > > Hi everyone, > > I would like to propose to deprecate embedded manifests > . This has been used before > the manife

Re: [VOTE] Deprecate and remove last-column-id

+1 (non-binding). The spec and code deprecation schedule looks good to me. Best, Kevin Liu On Tue, Nov 19, 2024 at 8:42 AM Christian Thiel wrote: > +1 (non-binding) – looks like we are going in the right direction in rust! > > > Christian > > > On 19. Nov 2024, at 16:13, J

Re: Changing Ownership and Cadence for Catalog Community Sync

Thanks, Honah, I received the new GCal invite. I double-checked the links for Google Meets and meeting notes, everything seems to be correct. Best, Kevin Liu On Tue, Nov 19, 2024 at 11:48 AM Honah J. wrote: > Thanks Jack! > > Hi everyone, I am very happy to help host the meeting serie

Re: [VOTE] Release Apache PyIceberg 0.8.0rc1

https://github.com/apache/iceberg-python/issues/1318 Best, Kevin Liu On Wed, Nov 13, 2024 at 7:37 PM Sung Yun wrote: > Hi folks, > > While testing out the Rest Catalog Adapter docker image that Ajantha has > been working working on, I ran into an issue when parsing the TableResponse

[VOTE] Release Apache PyIceberg 0.8.0rc2

ease vote in the next 72 hours. [ ] +1 Release this as PyIceberg 0.8.0 [ ] +0 [ ] -1 Do not release this because... Best, Kevin Liu

Re: [PROPOSAL] Create Iceberg DockerHub repository

image publishing. Best, Kevin Liu [1] https://github.com/apache/iceberg-python/pull/1321 On Fri, Nov 15, 2024 at 1:36 AM Fokko Driesprong wrote: > +1 — excited to see this happen! > > For the TCK, I think we can release this with the Java together, and have > a nightly build (tag t

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC2

+1 (non-binding) Verified checksum, signature, tests I modified the verify_rc script to use artifacts from the apache dist https://github.com/apache/iceberg-go/pull/205 ``` dev/release/verify_rc.sh 0.1.0 2 ``` Best, Kevin Liu On Thu, Nov 14, 2024 at 11:45 AM Jean-Baptiste Onofré wrote: >

Re: [ACTION REQUIRED] Removal of v3 artifact actions on December 5th

We merged the PR[1] to upgrade `upload-artifact` to V4. Thanks, Fokko for the review. Best, Kevin Liu [1] https://github.com/apache/iceberg-python/pull/1371 On Mon, Nov 25, 2024 at 10:36 PM Jean-Baptiste Onofré wrote: > Hi Kevin > > I did a quick search and I have the same feedba

Re: [DISCUSS] Apache Iceberg Summit 2025 - Selection Committee

Very excited about this. Happy to help! Best, Kevin Liu On Tue, Nov 26, 2024 at 9:32 AM himadri pal wrote: > Great to see the planning for another big Iceberg event!!! > Please consider me as a volunteer as well. > > Regards, > Himadri Pal > > > On Tue, Nov 26, 2024 at

[Proposal] Automating the PyIceberg Release Process

Pi. *Is this the direction we want to take for the release process? If so, what’s the best way to coordinate with ASF Infra to create the necessary credentials?* I’d love to hear your thoughts and any additional suggestions. Best, Kevin Liu

Re: [DISCUSS] Removal of last-column-id of public API

s://github.com/apache/iceberg-python/blob/b2f0a9e5cd7dd548e19cdcdd7f9205f03454369a/pyiceberg/table/update/__init__.py#L90-L91 Best, Kevin Liu On Thu, Nov 14, 2024 at 1:13 AM Fokko Driesprong wrote: > Hi everyone, > > While reviewing the TableMetadataBuilder PR on Iceberg-Rust

Re: [DISCUSS] Add a implementation status page for iceberg

Thanks, Renjie! Happy to review and help fill out the matrix! :) Best, Kevin Liu On Wed, Nov 13, 2024 at 10:51 PM Renjie Liu wrote: > Hi: > > Thanks for everyone's comments. I think we reached agreement on the > design, and I'll send a pr for it. > > On Tue, Nov

Re: Retry ValidationException with concurrent writes to the same partition

are other specifics you'd like to discuss. Best, Kevin Liu On Tue, Dec 3, 2024 at 3:12 PM Yufei Gu wrote: > If you’re looking for finer-grained isolation beyond the snapshot level, > the closest feature currently *WIP* is *Fine-Grained Commit* in the REST > catalog. You can find

Re: [Discuss] Replace Hadoop Catalog Examples with JDBC Catalog in Documentation

th an added example of configuring the REST Catalog. Please take a look and let me know what you think. Best, Kevin Liu On Thu, Oct 17, 2024 at 6:10 AM Marc Cenac wrote: > Hey Kevin, > > This approach sounds good to me and thanks for your work to improve > the getting started docs! I w

Re: [ANN] Apache Iceberg Summit 2025, dates, venue and CFP

Thanks for putting this together everyone. Looking forward to the event and meeting in person! Best, Kevin Liu On Tue, Jan 7, 2025 at 2:15 AM Jean-Baptiste Onofré wrote: > Hi everyone, > > With this new year comes a new announcement: Apache Iceberg Summit 2025 ! > > Iceberg S

Re: ​[discuss] Allow 200 responses for HEAD requests in REST API

on to sending 204 responses to fully adhere to the spec. Thanks all for the discussion! Best, Kevin Liu On Wed, Dec 18, 2024 at 1:00 AM Xuanwo wrote: > Hi, > > From my initial understanding of HTTP semantics, the HEAD request should > be treated like a GET request without a response b

Re: [VOTE] Add Geometry and Geography types for V3

+1 (non-binding) It's great to see support for more data types in both parquet and Iceberg! Best, Kevin Liu On Fri, Feb 7, 2025 at 12:11 PM huaxin gao wrote: > +1 (non-binding) > > On Fri, Feb 7, 2025 at 12:03 PM Honah J. wrote: > >> +1 >> >> Best regards,

Re: [Announce] Apache Iceberg Europe Community Meetup

alks will be recorded and made available on the Youtube Channel (@IcebergMeetup <https://www.youtube.com/@IcebergMeetup>)! Best, Kevin Liu On Wed, Feb 5, 2025 at 2:05 AM Christian Thiel wrote: > Oh sorry - here is the correct link: https://lu.ma/ewx2kuis > > On Wed, 5 Feb 2025 at

Re: Welcome Huaxin Gao as a committer!

Congratulations Huaxin!! Looking forward to working together 🎉 <https://emojipedia.org/party-popper> Best, Kevin Liu On Thu, Feb 6, 2025 at 7:30 AM Prashant Singh wrote: > Congratulations Huaxin ! > > Best, > Prashant Singh > > > On Thu, Feb 6, 2025 at

Re: [VOTE] Release Apache Iceberg 1.8.0 RC0

I also tested against pyiceberg's integration tests on my fork <https://github.com/kevinjqliu/iceberg-python/pull/9>. Thanks for running the release! Best, Kevin Liu Flaky tests: ``` > Task :iceberg-aws:test TestS3FileIO > testDeleteFilesSingleBatc

Re: [Announce] Singapore Apache Iceberg Community Meetup

Hey Denny, Here's one with a better resolution, https://drive.google.com/file/d/1H2scgq70fJU8AMLXzOadOdKfVPjHLDH9/view?usp=sharing Best, Kevin Liu On Mon, Dec 16, 2024 at 10:35 AM Denny Lee wrote: > Hey Kevin, > > Do you have a bigger image for this event so we can help promot

​[discuss] Allow 200 responses for HEAD requests in REST API

.com/apache/iceberg-python/issues/1363#issuecomment-2497462825>. Standardizing this behavior in the Catalog REST spec would promote consistency across implementations and make interactions easier for users and client developers. Would love to hear your thoughts on this proposal! Best, Kevin Liu

Re: [DISCUSS] Remove snapshot-id from IRC SetStatisticsUpdate

d for `last-column-id` in #11514 <https://github.com/apache/iceberg/pull/11514>. Best, Kevin Liu [1] https://github.com/apache/iceberg-python/pull/1285 On Mon, Dec 16, 2024 at 5:30 AM Fokko Driesprong wrote: > Hey Christian, > > Great catch, I would also be in favor of removing th

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC1

: No public key ``` Checksum is OK ``` ➜ shasum -a 512 --check apache-iceberg-rust-0.4.0-src.tar.gz.sha512 apache-iceberg-rust-0.4.0-src.tar.gz: OK ``` The verify script requires `chmod` to execute, but this is not a blocker. ``` chmod +x ./scripts/verify.py ``` Best, Kevin Liu On Tue, Dec 17, 2024 at 1

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC2

::test_file_io_s3_output test result: FAILED. 0 passed; 3 failed; 0 ignored; 0 measured; 0 filtered out; finished in 307.08s ``` Best, Kevin Liu On Tue, Dec 17, 2024 at 11:58 PM Renjie Liu wrote: > +1 binding. > > Did following verification: > > [*] Download links are valid.

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC2

2, 3, 4, 5, 6] pyarrow_array = pa.array(data) num_buckets = 2 bucketed_result = pyiceberg_core.transform.bucket(pyarrow_array, num_buckets) print(f"Bucketed Result: {bucketed_result}") ``` Best, Kevin Liu On Wed, Dec 18, 2024 at 8:41 AM Fokko Driesprong wrote: > Hey Kevin, >

Re: [ANNOUNCE] Apache Iceberg release 1.7.1

Thanks for driving the release Bryan! Best, Kevin Liu On Mon, Dec 9, 2024 at 10:45 PM Eduard Tudenhöfner wrote: > Thanks Bryan and everyone else for making this release happen. > > On Tue, Dec 10, 2024 at 12:27 AM Yuya Ebihara wrote: > >> Thank you Brian! Trino project ha

Re: [PROPOSAL] Create Iceberg DockerHub repository

/apache/iceberg-python/blob/a97d13c17cd03f86252b9df2c65532ec45fb05da/dev/docker-compose-integration.yml#L44> Thanks everyone for making this happen! Best, Kevin Liu On Mon, Dec 9, 2024 at 12:15 AM Jean-Baptiste Onofré wrote: > Hi Piotr > > That's a good point. > > As Do

Re: New committer: Scott Donnelly

Congrats Scott! Looking forward to collaborating with you in the future. Best, Kevin Liu On Wed, Dec 11, 2024 at 9:26 PM NOTME ZE wrote: > Congratulations Scott! > > huaxin gao 于2024年12月12日周四 06:12写道： > >> Congratulations Scott! >> >> On Wed, Dec 11, 2024 at

Re: New committer: Matt Topol

Congrats Matt!! On Wed, Dec 11, 2024 at 2:12 PM huaxin gao wrote: > Congratulations, Matt! > > On Tue, Dec 10, 2024 at 11:13 PM Eduard Tudenhöfner < > etudenhoef...@apache.org> wrote: > >> Congrats Matt! >> >> On Wed, Dec 11, 2024 at 6:41 AM Honah J. wrote: >> >>> Congratulations, Matt! >>> >>>

[Announce] Singapore Apache Iceberg Community Meetup

- Iceberg in Python Presentations will be recorded and uploaded to the Iceberg meetup YouTube channel (https://www.youtube.com/@IcebergMeetup) Best, Kevin Liu

Re: [DISCUSS] December board report

) Community * Several reoccurring community meetups have started in Seattle/SF/Singapore and more are planned * Meetup presentations are recorded and available on the Apache Iceberg Meetup YouTube channel (https://www.youtube.com/@IcebergMeetup) Best, Kevin Liu On Wed, Dec 11, 2024 at 10:30 PM Péter

Re: [PROPOSAL] Create Iceberg DockerHub repository

against the nightly. In this > case, when there are changes or new features, we can test/implement them > right away. > > Kind regards, > Fokko > > Op vr 22 nov 2024 om 18:11 schreef Kevin Liu : > >> Thanks for setting this up, JB! It looks like PR #11283 >> <htt

Re: [Discuss] Simplify tableExists API in HiveCatalog

in the documentation. Thanks, Kevin Liu On Fri, Nov 22, 2024 at 11:57 AM Szehon Ho wrote: > Should add, my personal preference is probably not to change the existing > behavior for this part (false, if exists a Hive table with same name) at > the moment, just adding another pos

Re: [Discuss] Simplify tableExists API in HiveCatalog

ts on this. Best, Kevin Liu On Thu, Nov 21, 2024 at 5:22 PM Szehon Ho wrote: > Hi, > > It's a good performance find and improvement. Left some comment on the > PR. > > IMO, the behavior actually more matches the API javadoc ("Check whether > table exists"), n

  1   2   >