Re: Welcome Huaxin Gao as a committer!

Congratulations Huaxin!! Looking forward to working together 🎉 <https://emojipedia.org/party-popper> Best, Kevin Liu On Thu, Feb 6, 2025 at 7:30 AM Prashant Singh wrote: > Congratulations Huaxin ! > > Best, > Prashant Singh > > > On Thu, Feb 6, 2025 at

Re: [Iceberg Summit 25] Registration is live!

for that? Best, Kevin Liu On Wed, Jan 29, 2025 at 1:56 AM Jean-Baptiste Onofré wrote: > Hi folks, > > I'm very happy to share that the registration for the Iceberg Summit > 2025 is officially live! > > https://www.icebergsummit2025.com/ > > We are looking forward t

Re: [VOTE] Release Apache Iceberg 1.7.2 rc0

nds$3(TestHadoopCommits.java:455) ``` Best, Kevin Liu On Tue, Jan 28, 2025 at 10:40 AM Jean-Baptiste Onofré wrote: > Just to be clear: we are working on new changes on NOTICE/LICENSE that > would be great to include in 1.7.x. > > See https://github.com/apache/polaris/pull/903 > >

Re: [Discussion] Proposal for Iceberg Community Meetup Guidelines

is up. Best, Kevin Liu On Fri, Jan 24, 2025 at 5:10 PM Yuya Ebihara wrote: > Hi Kevin, > > I believe such a section is beneficial. I started planning a local event > in Japan recently, but the recommended actions were unclear even though I > read https://iceberg.apache.org/community/#

Re: [VOTE] Add initial/write defaults to REST spec

+1 (non-binding) Thanks Dan! I double-checked that it aligns with V3 default value as described by the spec, https://iceberg.apache.org/spec/#default-values Best, Kevin Liu On Fri, Jan 24, 2025 at 8:14 AM Daniel Weeks wrote: > Everyone, > > I'd like to hold a quick vote for a

[Discussion] Proposal for Iceberg Community Meetup Guidelines

e and SF/Bay Area events. Call to Action I’d love to hear your thoughts and feedback on this proposal. If you’re interested in starting a local event, please post on the dev list or reach out to me directly. Best, Kevin Liu

[discuss] Standardizing Naming Schemes for Language-Specific Configurations

use of the `py-` prefix for Python-specific configurations and extending this naming scheme to other languages, such as Rust, Go, and C++. This would create a consistent, predictable pattern for language-specific configuration parameters across the project. Looking forward to hearing your thoughts! Best, Kevin Liu

Re: [VOTE] Document Snapshot Summary Optional Fields as Subsection of Appendix F in Spec

+1 non-binding Third time's the charm! :) On Wed, Jan 22, 2025 at 4:44 AM Jean-Baptiste Onofré wrote: > +1 (non binding) > > Regards > JB > > On Tue, Jan 21, 2025 at 9:19 PM Honah J. wrote: > > > > Hi everyone, > > > > In the last VOTE thread on documenting snapshot summary optional fields, >

Re: [VOTE] Deprecate IRC snapshot-id Field of SetStatisticsUpdate

+1 (non-binding) Thanks Christian! I also created an issue to track the deprecation for the pyiceberg side https://github.com/apache/iceberg-python/issues/1556 Best, Kevin Liu On Tue, Jan 21, 2025 at 8:39 AM Eduard Tudenhöfner wrote: > +1 > > On Tue, Jan 21, 2025 at 5:34 PM M

Re: [DISCUSS] Use pr title + pr description as default git commit title + message in iceberg-rust

r `iceberg-python` and possibly for `iceberg-go` as well. Best, Kevin Liu On Mon, Jan 13, 2025 at 9:03 PM Honah J. wrote: > Hi everyone, > > +1 > > I remember that I manually copy-pasting PR descriptions into merge commit > messages multiple times. PRs often accumulate numer

Re: [VOTE] Document Snapshot Summary Optional Fields as Appendix in Spec

+1 non-binding. Already +1 and reviewed the PR. Thanks for adding this! It's very useful as a reference. Best, Kevin Liu On Tue, Jan 14, 2025 at 12:05 PM Russell Spitzer wrote: > +1 > > On Tue, Jan 14, 2025 at 2:00 PM Honah J. wrote: > >> Hi everyone, >> >

Re: [ANN] Apache Iceberg Summit 2025, dates, venue and CFP

Thanks for putting this together everyone. Looking forward to the event and meeting in person! Best, Kevin Liu On Tue, Jan 7, 2025 at 2:15 AM Jean-Baptiste Onofré wrote: > Hi everyone, > > With this new year comes a new announcement: Apache Iceberg Summit 2025 ! > > Iceberg S

Re: ​[discuss] Allow 200 responses for HEAD requests in REST API

on to sending 204 responses to fully adhere to the spec. Thanks all for the discussion! Best, Kevin Liu On Wed, Dec 18, 2024 at 1:00 AM Xuanwo wrote: > Hi, > > From my initial understanding of HTTP semantics, the HEAD request should > be treated like a GET request without a response b

Re: [Discuss] Replace Hadoop Catalog Examples with JDBC Catalog in Documentation

th an added example of configuring the REST Catalog. Please take a look and let me know what you think. Best, Kevin Liu On Thu, Oct 17, 2024 at 6:10 AM Marc Cenac wrote: > Hey Kevin, > > This approach sounds good to me and thanks for your work to improve > the getting started docs! I w

Re: [ANNOUNCE] Release Apache Iceberg Rust v0.4.0

Thanks for driving the release Sung! Excited to see the new rust library release and the new pyiceberg_core <https://pypi.org/project/pyiceberg-core/> python library powered by rust :) Happy holidays! Best, Kevin Liu On Mon, Dec 23, 2024 at 9:56 PM Renjie Liu wrote: > Thanks for dri

Re: [DISCUSS] Add a implementation status page for iceberg

Thanks for driving this Renjie! The new page looks great and we'll refine it more over time :) Happy holidays! Best, Kevin Liu On Mon, Dec 23, 2024 at 7:52 PM Manu Zhang wrote: > Thanks Renjie for landing the page and others for the review! > > M

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC3

apache/iceberg-rust/blob/main/CONTRIBUTING.md#install-docker-or-podman and apache/iceberg-rust/#748 <https://github.com/apache/iceberg-rust/pull/748> Best, Kevin Liu On Mon, Dec 23, 2024 at 1:41 PM Christian Thiel wrote: > +1 non-binding > > [x] Download links are valid. > [x] Checks

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC2

2, 3, 4, 5, 6] pyarrow_array = pa.array(data) num_buckets = 2 bucketed_result = pyiceberg_core.transform.bucket(pyarrow_array, num_buckets) print(f"Bucketed Result: {bucketed_result}") ``` Best, Kevin Liu On Wed, Dec 18, 2024 at 8:41 AM Fokko Driesprong wrote: > Hey Kevin, >

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC2

::test_file_io_s3_output test result: FAILED. 0 passed; 3 failed; 0 ignored; 0 measured; 0 filtered out; finished in 307.08s ``` Best, Kevin Liu On Tue, Dec 17, 2024 at 11:58 PM Renjie Liu wrote: > +1 binding. > > Did following verification: > > [*] Download links are valid.

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC1

: No public key ``` Checksum is OK ``` ➜ shasum -a 512 --check apache-iceberg-rust-0.4.0-src.tar.gz.sha512 apache-iceberg-rust-0.4.0-src.tar.gz: OK ``` The verify script requires `chmod` to execute, but this is not a blocker. ``` chmod +x ./scripts/verify.py ``` Best, Kevin Liu On Tue, Dec 17, 2024 at 1

​[discuss] Allow 200 responses for HEAD requests in REST API

.com/apache/iceberg-python/issues/1363#issuecomment-2497462825>. Standardizing this behavior in the Catalog REST spec would promote consistency across implementations and make interactions easier for users and client developers. Would love to hear your thoughts on this proposal! Best, Kevin Liu

Re: [DISCUSS] Remove snapshot-id from IRC SetStatisticsUpdate

d for `last-column-id` in #11514 <https://github.com/apache/iceberg/pull/11514>. Best, Kevin Liu [1] https://github.com/apache/iceberg-python/pull/1285 On Mon, Dec 16, 2024 at 5:30 AM Fokko Driesprong wrote: > Hey Christian, > > Great catch, I would also be in favor of removing th

Re: [Announce] Singapore Apache Iceberg Community Meetup

Hey Denny, Here's one with a better resolution, https://drive.google.com/file/d/1H2scgq70fJU8AMLXzOadOdKfVPjHLDH9/view?usp=sharing Best, Kevin Liu On Mon, Dec 16, 2024 at 10:35 AM Denny Lee wrote: > Hey Kevin, > > Do you have a bigger image for this event so we can help promot

Re: [PROPOSAL] Create Iceberg DockerHub repository

/apache/iceberg-python/blob/a97d13c17cd03f86252b9df2c65532ec45fb05da/dev/docker-compose-integration.yml#L44> Thanks everyone for making this happen! Best, Kevin Liu On Mon, Dec 9, 2024 at 12:15 AM Jean-Baptiste Onofré wrote: > Hi Piotr > > That's a good point. > > As Do

[Announce] Singapore Apache Iceberg Community Meetup

- Iceberg in Python Presentations will be recorded and uploaded to the Iceberg meetup YouTube channel (https://www.youtube.com/@IcebergMeetup) Best, Kevin Liu

Re: [DISCUSS] December board report

) Community * Several reoccurring community meetups have started in Seattle/SF/Singapore and more are planned * Meetup presentations are recorded and available on the Apache Iceberg Meetup YouTube channel (https://www.youtube.com/@IcebergMeetup) Best, Kevin Liu On Wed, Dec 11, 2024 at 10:30 PM Péter

Re: [ANNOUNCE] Apache Iceberg release 1.7.1

Thanks for driving the release Bryan! Best, Kevin Liu On Mon, Dec 9, 2024 at 10:45 PM Eduard Tudenhöfner wrote: > Thanks Bryan and everyone else for making this release happen. > > On Tue, Dec 10, 2024 at 12:27 AM Yuya Ebihara wrote: > >> Thank you Brian! Trino project ha

Re: New committer: Matt Topol

Congrats Matt!! On Wed, Dec 11, 2024 at 2:12 PM huaxin gao wrote: > Congratulations, Matt! > > On Tue, Dec 10, 2024 at 11:13 PM Eduard Tudenhöfner < > etudenhoef...@apache.org> wrote: > >> Congrats Matt! >> >> On Wed, Dec 11, 2024 at 6:41 AM Honah J. wrote: >> >>> Congratulations, Matt! >>> >>>

Re: New committer: Scott Donnelly

Congrats Scott! Looking forward to collaborating with you in the future. Best, Kevin Liu On Wed, Dec 11, 2024 at 9:26 PM NOTME ZE wrote: > Congratulations Scott! > > huaxin gao 于2024年12月12日周四 06:12写道： > >> Congratulations Scott! >> >> On Wed, Dec 11, 2024 at

Re: [VOTE] Release Apache PyIceberg 0.8.1rc1

Hi Honah and Eduard, Following up on the test failures you both encountered, I opened apache/iceberg-python issues #1409 <https://github.com/apache/iceberg-python/issues/1409> to track this. Thanks for taking the time to verify the release! Best, Kevin Liu On Fri, Dec 6, 2024 at 9:41 AM

[ANNOUNCE] Apache PyIceberg release 0.8.1

table evolution. This Python release can be downloaded from: https://pypi.org/project/pyiceberg/0.8.1/ Thanks to everyone for contributing! Best, Kevin Liu

Re: [VOTE] Release Apache PyIceberg 0.8.1rc1

out once all artifacts are published. Best, Kevin liu On Fri, Dec 6, 2024 at 7:49 AM Eduard Tudenhöfner wrote: > +1 (binding) but I've also had the same tests fail that Honah mentioned > earlier (which are due to deprecated dependencies) > > On Wed, Dec 4, 2024 at 3:52 A

Re: [Proposal] Automating the PyIceberg Release Process

he artifacts. I can generate a new PyPI token using my own PyPI account, or we could request one from ASF Infra. Thanks again for your help! Best, Kevin Liu [1] https://reproducible-builds.org/ [2] https://github.com/wimglenn/setuptools-reproducible On Tue, Dec 3, 2024 at 1:31 AM Fokko Driesprong

Re: [VOTE] Release Apache Iceberg 1.7.1 RC1

conflicting port, I was able to successfully build and run the tests using Java 21. Best, Kevin Liu [1] https://github.com/apache/iceberg/blob/6501d29b2d46c8d57f46ad646e2daf7d8865f646/kafka-connect/kafka-connect-runtime/docker/docker-compose.yml#L29-L49 On Tue, Dec 3, 2024 at 4:31 PM Yufei Gu wrote

Re: Retry ValidationException with concurrent writes to the same partition

are other specifics you'd like to discuss. Best, Kevin Liu On Tue, Dec 3, 2024 at 3:12 PM Yufei Gu wrote: > If you’re looking for finer-grained isolation beyond the snapshot level, > the closest feature currently *WIP* is *Fine-Grained Commit* in the REST > catalog. You can find

Re: [VOTE] Release Apache Iceberg 1.7.1 RC1

tainerLaunchException: Container startup failed for image docker:24.0.2 ``` and I double-checked that `docker` is indeed running on my laptop. Best, Kevin Liu On Tue, Dec 3, 2024 at 7:31 AM Jean-Baptiste Onofré wrote: > +1 (non binding) > > Regards > JB > > On Thu, Nov 2

[Proposal] Automating the PyIceberg Release Process

Pi. *Is this the direction we want to take for the release process? If so, what’s the best way to coordinate with ASF Infra to create the necessary credentials?* I’d love to hear your thoughts and any additional suggestions. Best, Kevin Liu

Re: [VOTE] Release Apache PyIceberg 0.8.1rc1

create a new patch version using `0.8.2`. How does that sound? Additionally, I created a PR to prevent this from happening again. https://github.com/apache/iceberg-python/pull/1386 Best, Kevin Liu On Wed, Nov 27, 2024 at 5:07 PM Sung Yun wrote: > Hi Kevin, > > Thank you so much for w

[VOTE] Release Apache PyIceberg 0.8.1rc1

Release this as PyIceberg 0.8.1 [ ] +0 [ ] -1 Do not release this because... Best, Kevin Liu

Re: [Discuss] Document Snapshot Summary Optional Fields for Standardization

cification changes require greater scrutiny. > summary details would not be located near the Snapshot section, which explains the summary field. We can link the table to the Snapshot section. Would love to hear others' thoughts on this. Best, Kevin Liu On Tue, Nov 26, 2024 at 2:50 PM Honah

Re: [DISCUSS] iceberg rust 0.4.0 and iceberg pyiceberg_core 0.1.0 release

We'd want to release pyiceberg_core features independent of iceberg-rust features. Please let me know if there's anything I can do to help. Best, Kevin Liu On Wed, Nov 27, 2024 at 6:13 AM Sung Yun wrote: > Hi folks, it's been some time since we've done an Iceberg Rust releas

Re: [ACTION REQUIRED] Removal of v3 artifact actions on December 5th

-artifact%40v3&type=code * https://github.com/search?q=org%3Aapache+download-artifact%40v3&type=code Looks like `iceberg-rust` is the only place we missed. Best, Kevin Liu On Wed, Nov 27, 2024 at 5:45 AM Sung Yun wrote: > Hi JB and Kevin, thank you for jumping on the chore. > >

Re: [ACTION REQUIRED] Removal of v3 artifact actions on December 5th

We merged the PR[1] to upgrade `upload-artifact` to V4. Thanks, Fokko for the review. Best, Kevin Liu [1] https://github.com/apache/iceberg-python/pull/1371 On Mon, Nov 25, 2024 at 10:36 PM Jean-Baptiste Onofré wrote: > Hi Kevin > > I did a quick search and I have the same feedba

Re: [DISCUSS] Apache Iceberg Summit 2025 - Selection Committee

Very excited about this. Happy to help! Best, Kevin Liu On Tue, Nov 26, 2024 at 9:32 AM himadri pal wrote: > Great to see the planning for another big Iceberg event!!! > Please consider me as a volunteer as well. > > Regards, > Himadri Pal > > > On Tue, Nov 26, 2024 at

Re: [ACTION REQUIRED] Removal of v3 artifact actions on December 5th

.pattern][0]=apache/iceberg Only iceberg-python is affected. Here's the PR to update the relevant action, https://github.com/apache/iceberg-python/pull/1371 Best, Kevin Liu On Mon, Nov 25, 2024 at 10:36 AM Jacob Wujciak wrote: > Hello Everyone! > > I am writing to inform you of t

Re: [DISCUSS] PyIceberg 0.8.1 release

/pull/1369 Please let me know what you think. Best, Kevin Liu On Thu, Nov 21, 2024 at 10:05 AM Kevin Liu wrote: > Thanks for starting this thread! > > Along with the 2 issues listed above, I propose this issue as well > * Ignore tables with missing table_type parameter in HMS an

Re: [Discuss] Simplify tableExists API in HiveCatalog

in the documentation. Thanks, Kevin Liu On Fri, Nov 22, 2024 at 11:57 AM Szehon Ho wrote: > Should add, my personal preference is probably not to change the existing > behavior for this part (false, if exists a Hive table with same name) at > the moment, just adding another pos

Re: [PROPOSAL] Create Iceberg DockerHub repository

against the nightly. In this > case, when there are changes or new features, we can test/implement them > right away. > > Kind regards, > Fokko > > Op vr 22 nov 2024 om 18:11 schreef Kevin Liu : > >> Thanks for setting this up, JB! It looks like PR #11283 >> <htt

Re: [PROPOSAL] Create Iceberg DockerHub repository

yone’s thoughts on this! Best regards, Kevin Liu On Fri, Nov 22, 2024 at 6:06 AM Jean-Baptiste Onofré wrote: > Hi folks, > > I created the iceberg repo on DockerHub (in the Apache org): > > https://hub.docker.com/r/apache/iceberg > > I created an "Iceberg team" on Do

Re: [VOTE] Release Apache Iceberg 1.7.1 RC1

Thanks for adding that PR to the patch release! This should only affect the release script, and only this once :). I see that the documentation site has already been updated. https://iceberg.apache.org/how-to-release/#setup Best, Kevin Liu On Fri, Nov 22, 2024 at 6:36 AM Bryan Keller wrote

Re: [Discuss] Simplify tableExists API in HiveCatalog

ts on this. Best, Kevin Liu On Thu, Nov 21, 2024 at 5:22 PM Szehon Ho wrote: > Hi, > > It's a good performance find and improvement. Left some comment on the > PR. > > IMO, the behavior actually more matches the API javadoc ("Check whether > table exists"), n

Re: [DISCUSS] PyIceberg 0.8.1 release

Thanks for starting this thread! Along with the 2 issues listed above, I propose this issue as well * Ignore tables with missing table_type parameter in HMS and Glue (#1331 <https://github.com/apache/iceberg-python/issues/1331>) Best, Kevin Liu On Thu, Nov 21, 2024 at 5:18 AM Jean-Ba

Re: Changing Ownership and Cadence for Catalog Community Sync

Thanks, Honah, I received the new GCal invite. I double-checked the links for Google Meets and meeting notes, everything seems to be correct. Best, Kevin Liu On Tue, Nov 19, 2024 at 11:48 AM Honah J. wrote: > Thanks Jack! > > Hi everyone, I am very happy to help host the meeting serie

Re: [DISCUSS] Deprecate embedded manifests

+1 On Tue, Nov 19, 2024 at 9:23 AM Bryan Keller wrote: > +1 to deprecate > > On Nov 19, 2024, at 3:32 AM, Fokko Driesprong wrote: > > Hi everyone, > > I would like to propose to deprecate embedded manifests > . This has been used before > the manife

Re: [VOTE] Deprecate and remove last-column-id

+1 (non-binding). The spec and code deprecation schedule looks good to me. Best, Kevin Liu On Tue, Nov 19, 2024 at 8:42 AM Christian Thiel wrote: > +1 (non-binding) – looks like we are going in the right direction in rust! > > > Christian > > > On 19. Nov 2024, at 16:13, J

Re: [ANNOUNCE] Apache Iceberg Go release v0.1.0

Excited to see the first official release of the Apache Iceberg Go library! Thanks everyone for contributing! And thanks Matt & Fokko for working on the release. Cheers, Kevin Liu On Mon, Nov 18, 2024 at 11:10 AM Matt Topol wrote: > Hi everyone, > > I'm pleased to annou

Re: [VOTE] Release Apache PyIceberg 0.8.0rc2

PyIceberg 0.8.0. Thanks everyone, when all artifacts are published the announcement will be sent out. Best, Kevin Liu On Mon, Nov 18, 2024 at 10:07 AM Daniel Weeks wrote: > +1 (binding) > > Verified sigs/sums/license/tests+s3 (Python 3.11.9) > > -Dan > > On Sat, Nov 16, 2024

[ANNOUNCE] Apache PyIceberg release 0.8.0

table evolution. This Python release can be downloaded from: https://pypi.org/project/pyiceberg/0.8.0/ Thanks to everyone for contributing! Best, Kevin Liu

Re: [DISCUSS] Add a implementation status page for iceberg

Thanks, Renjie! Happy to review and help fill out the matrix! :) Best, Kevin Liu On Wed, Nov 13, 2024 at 10:51 PM Renjie Liu wrote: > Hi: > > Thanks for everyone's comments. I think we reached agreement on the > design, and I'll send a pr for it. > > On Tue, Nov

Re: [DISCUSS] Removal of last-column-id of public API

s://github.com/apache/iceberg-python/blob/b2f0a9e5cd7dd548e19cdcdd7f9205f03454369a/pyiceberg/table/update/__init__.py#L90-L91 Best, Kevin Liu On Thu, Nov 14, 2024 at 1:13 AM Fokko Driesprong wrote: > Hi everyone, > > While reviewing the TableMetadataBuilder PR on Iceberg-Rust

Re: [PROPOSAL] Create Iceberg DockerHub repository

image publishing. Best, Kevin Liu [1] https://github.com/apache/iceberg-python/pull/1321 On Fri, Nov 15, 2024 at 1:36 AM Fokko Driesprong wrote: > +1 — excited to see this happen! > > For the TCK, I think we can release this with the Java together, and have > a nightly build (tag t

[VOTE] Release Apache PyIceberg 0.8.0rc2

ease vote in the next 72 hours. [ ] +1 Release this as PyIceberg 0.8.0 [ ] +0 [ ] -1 Do not release this because... Best, Kevin Liu

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC2

+1 (non-binding) Verified checksum, signature, tests I modified the verify_rc script to use artifacts from the apache dist https://github.com/apache/iceberg-go/pull/205 ``` dev/release/verify_rc.sh 0.1.0 2 ``` Best, Kevin Liu On Thu, Nov 14, 2024 at 11:45 AM Jean-Baptiste Onofré wrote: >

Re: [VOTE] Release Apache PyIceberg 0.8.0rc1

https://github.com/apache/iceberg-python/issues/1318 Best, Kevin Liu On Wed, Nov 13, 2024 at 7:37 PM Sung Yun wrote: > Hi folks, > > While testing out the Rest Catalog Adapter docker image that Ajantha has > been working working on, I ran into an issue when parsing the TableResponse

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC1

ix the issue [3], I've verified using my own forked repo. Sorry for the churn here, I should have tested the previous PR more closely. Best, Kevin Liu [1] https://github.com/apache/iceberg-go/releases/tag/v0.1.0-rc1 [2] https://github.com/apache/iceberg-go/commit/8ca0bb7bdf7868bac4aca83f5

Re: [DISCUSS] Duplicate KEYS files

re updated https://github.com/search?q=%22dist.apache.org%2Frepos%2Fdist%2Fdev%2Ficeberg%2FKEYS%22+org%3Aapache&type=code I also double-checked that the dev KEYS are removed (had to flush the cache again) https://dist.apache.org/repos/dist/dev/iceberg/KEYS Best, Kevin Liu On Tue, Nov 12, 2024 at 11:3

Re: [DISCUSS] Duplicate KEYS files

`downloads`. https://downloads.apache.org/iceberg/KEYS https://dist.apache.org/repos/dist/release/iceberg/KEYS Best, Kevin Liu On Tue, Nov 12, 2024 at 9:02 AM Kevin Liu wrote: > Hey folks, > > As mentioned in the previous email. Here are the references to > `dist/dev/iceberg/KEYS` > https://

Re: [DISCUSS] Duplicate KEYS files

y are the same. ``` ➜ ~ curl -s https://downloads.apache.org/iceberg/KEYS | md5sum 905987ebcc39a70ebcbce89f1939fe26 - ➜ ~ curl -s https://dist.apache.org/repos/dist/release/iceberg/KEYS | md5sum 905987ebcc39a70ebcbce89f1939fe26 - ``` Best, Kevin Liu On Tue, Nov 12, 2024 at 9:36 AM Russell Sp

Re: [DISCUSS] Duplicate KEYS files

/pull/1315 - iceberg-go https://github.com/apache/iceberg-go/pull/200 - iceberg https://github.com/apache/iceberg/pull/11526 We will probably want to merge and remove the dev KEYS first. Thanks, Kevin Liu On Mon, Nov 11, 2024 at 11:52 PM Jean-Baptiste Onofré wrote: > Hi Fokko > &

Re: [DISCUSS] Duplicate KEYS files

o edit it by hand. > > On Tue, Nov 12, 2024, at 10:16, Kevin Liu wrote: > > Does anyone know how to edit the KEYS file at > https://downloads.apache.org/iceberg/KEYS? > The previous instruction [1] uses `svn` which doesn't work with the above > URL. > ``` > svn co http

Re: [DISCUSS] Duplicate KEYS files

eberg icebergsvn # fails ``` Best, Kevin Liu [1] https://github.com/apache/iceberg-python/pull/1315/files#diff-4e59fab01a772c9c96d23c5ca8a2cce6e1500a71bdf32ad4cb8bec6319d0bdf0L88 On Mon, Nov 11, 2024 at 5:47 PM Renjie Liu wrote: > +1 (binding) for merging. > > On Tue, Nov 12, 2024 at 1:56 AM Ke

Re: Greater Seattle Iceberg Meetup

cover the overview of the `iceberg-python` project and explore some powerful features that can be integrated into your current data stack. Talks will be recorded and uploaded to YouTube ( https://www.youtube.com/@IcebergMeetup) Best, Kevin Liu On Fri, Oct 18, 2024 at 4:45 PM Kevin Liu wrote:

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC0

BTW for folks verifying this RC, these are the changes I made locally for the `dev/release/verify_rc.sh` script to work. https://github.com/apache/iceberg-go/pull/199/files Best, Kevin Liu On Mon, Nov 11, 2024 at 3:03 PM Kevin Liu wrote: > Hi Matt, > > Thanks for the release candidate

Re: [VOTE][Go] Release Apache Iceberg Go v0.1.0 RC0

fy_rc.sh` and also upload the KEYS to https://dist.apache.org/repos/dist/dev/iceberg/KEYS? Best, Kevin Liu On Mon, Nov 11, 2024 at 2:12 PM Matt Topol wrote: > Hi, > > I would like to propose the following release candidate (RC0) of Apache > Iceberg Go version v0.1.0. > > This rele

Re: [DISCUSS] Duplicate KEYS files

ep.app/search?q=/KEYS&case=true&filter[repo.pattern][0]=iceberg Best, Kevin Liu On Mon, Nov 11, 2024 at 9:45 AM Matt Topol wrote: > +1 (non-binding) for merging, I can update the docs on the iceberg Go > release README after it's done! > > On Mon, Nov 11, 2024, 12:20 PM Yufe

Re: [DISCUSS][Go] First release of iceberg-go

Oh this looks great! Very well documented. I just went through the release process for PyIceberg. I should have the proper permissions (the KEYS took me a while to set up). Happy to help run these commands :) Best, Kevin Liu On Fri, Nov 8, 2024 at 9:46 AM Matt Topol wrote: > Thanks g

Re: [DISCUSS][Go] First release of iceberg-go

Hi Matt, Happy to be a reviewer too. I don't know enough about the Go ecosystem to be a release manager. I hope we can document the process for others in the future. Best, Kevin Liu On Fri, Nov 8, 2024 at 6:47 AM Jean-Baptiste Onofré wrote: > Hi Matt > > It sounds good to me. I

Re: [DISCUSS] Add a implementation status page for iceberg

d to making this happen! And happy to help in any way. Best, Kevin Liu On Fri, Nov 8, 2024 at 6:33 AM Russell Spitzer wrote: > Sounds like a great idea to me > > On Fri, Nov 8, 2024 at 7:58 AM Renjie Liu wrote: > >> Hi: >> >> As iceberg evolved to a multi-lang pro

Re: [ANNOUNCE] Apache Iceberg release 1.7.0

Woot! Thank you Russell for driving the release! Best, Kevin Liu On Fri, Nov 8, 2024 at 8:43 AM Russell Spitzer wrote: > Yes that would be part of the docs that I am still in the process of > updating > > On Fri, Nov 8, 2024 at 10:22 AM Rodrigo Meneses > wrote: > >> Th

[VOTE] Release Apache PyIceberg 0.8.0rc1

sting entries when there are deletes - Handle Empty RecordBatch within _task_to_record_batches Please vote in the next 72 hours. [ ] +1 Release this as PyIceberg 0.8.0 [ ] +0 [ ] -1 Do not release this because... Best, Kevin Liu

Re: [VOTE] Release Apache Iceberg 1.7.0 RC1

+1 non-binding Verified signatures, checksums, and license Ran build and tests with JDK17 Best, Kevin Liu On Thu, Nov 7, 2024 at 7:24 AM Prashant Singh wrote: > Thank you Russell ! > > +1 (non-binding) > - Verified signature, checksum, license, build. > - ran our internal s

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

pecification to ensure that other operations interact with a compliant table. Perhaps we could permit `SnapshotParser` to read the metadata but enforce the `operation` field at a different location to guarantee the table’s compliance with the specification. Best, Kevin Liu [1] https://github.com

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

Thanks, everyone! The PR[1] has been merged Best, Kevin Liu [1] https://github.com/apache/iceberg/pull/11354 On Fri, Oct 25, 2024 at 1:02 PM Kevin Liu wrote: > Thanks, Ryan! That makes sense. > > I want to follow up on the original issue. I've made a PR [1] to enforce >

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

Thanks, Ryan! That makes sense. I want to follow up on the original issue. I've made a PR [1] to enforce that the Snapshot `summary` map must have an `operation` key. Please take a look. Thank you @nastra for the comments and reviews. Best, Kevin Liu [1] https://github.com/apache/iceberg

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

uuid` [2][3] and `Snapshot.summary` [4][5]. Would love to get other people's thoughts on this. Best, Kevin Liu [1] https://github.com/apache/iceberg/pull/11354 [2] https://github.com/apache/iceberg/blob/8e743a5b5209569f84b6bace36e1106c67e1eab3/open-api/rest-catalog-open-api.yaml#L2414 [3] https://ic

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

and guidance on upgrading from one version to another. I’d love to hear everyone’s thoughts on this. Best, Kevin Liu [1] https://github.com/apache/iceberg/pull/11354 [2] https://github.com/apache/iceberg/blob/17f1c4d2205b59c2bd877d4d31bbbef9e90979c5/core/src/main/java/org/apache/iceberg/Snapsho

Re: Greater Seattle Iceberg Meetup

Thanks, Jonathan. Looking forward to seeing everyone! Please let us know if you would like to present by filling out this form https://docs.google.com/forms/d/1vic-6nUYbUTsf_WmyQ0kB_7BrSdpT97Rfh2cL3cs2kw/edit Best, Kevin Liu On Fri, Oct 18, 2024 at 4:16 PM Jonathan Leang wrote: > Hi every

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

2] in the Iceberg repo contains the latest version of the spec. As we're continuing to evolve to spec for V3, would it be helpful to create a frozen version representing both the V1 and V2 specs for reference, possibly as a separate file? Best, Kevin Liu [1] https://github.com/apache/ice

Re: [DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

pt" : "0", "total-files-size" : "3927895626752", "added-records" : "26508666891", "added-data-files" : "231513", "manifests-replaced" : "0", "total-data-files" :

[DISCUSS] Discrepancy Between Iceberg Spec and Java Implementation for Snapshot summary's 'operation' key

ement? Additionally, how should we handle existing `metadata.json` files that were generated without this field? Best, Kevin Liu [1] https://iceberg.apache.org/spec/#table-metadata-and-snapshots [2] https://github.com/apache/iceberg/blob/8e2eb9ac2e33ce4bac8956d4e2f099444d03c0e3/open-api/rest-catalog-open-api

Re: [Discuss] Replace Hadoop Catalog Examples with JDBC Catalog in Documentation

ickly prototype while also guiding them toward the REST catalog for production use cases. Looking forward to hearing more from you all. Best, Kevin Liu [1] https://lists.apache.org/thread/xl1cwq7vmnh6zgfd2vck2nq7dfd33ncq On Thu, Oct 10, 2024 at 3:44 AM Eduard Tudenhöfner wrote: >

Re: [DISCUSS] [PyIceberg] Use of asserts to "programming the negative space"

x27;m not sure where we can draw the line between using assert/pre-conditions and using if/raise clauses. Best, Kevin Liu [1] https://github.com/apache/iceberg-python/blob/7cf0c225c3cdb32ac5e390de06b7b0e4fe7de92e/pyiceberg/io/pyarrow.py#L2515-L2518 On Wed, Oct 16, 2024 at 12:02 AM Piotr Findeisen

Re: [DISCUSS] Iceberg Rust Sync Meeting

+1 on sync meeting for iceberg rust. I want to get involved and catch up on the recent developments. For reference, here's the doc we've been using for the pyiceberg sync https://docs.google.com/document/d/1oMKodaZJrOJjPfc8PDVAoTdl02eGQKHlhwuggiw7s9U Best, Kevin On Wed, Oct 9, 2024 at 5:30 AM Xua

[Discuss] Replace Hadoop Catalog Examples with JDBC Catalog in Documentation

ue [3] and a PR [4] to address this. Please take a look, and I'd love to hear your thoughts on whether this is a direction we want to pursue. Best, Kevin Liu [1] https://iceberg.apache.org/spark-quickstart/#adding-a-catalog [2] https://iceberg.apache.org/docs/nightly/spark-getting-start

Re: Clarification on DayTransform Result Type

the Spark type, it shows up as date and Spark > correctly displays the value. > > On Mon, Sep 30, 2024 at 9:56 AM Kevin Liu wrote: > >> Thank you both for the insights and context. >> >> As Russell pointed out, the "day partition transform" result is true of

Re: Bayarea Iceberg meetup in November

Excited about this, looking forward to it! Best, Kevin On Thu, Oct 3, 2024 at 6:11 PM Aihua Xu wrote: > Hi community! > > The Apache Iceberg community is gathering in San Francisco on November > 4th. Whether you’re interested in presenting or just want to join us for > some networking, you can

Re: [DISCUSS] Iceberg Summit 2025 ?

+1 to hybrid event with an in-person element. Things I like to see: * Real-world experience from companies running Iceberg at scale * Iceberg catalogs and how it's used * Integrations with open-source projects in the broader ecosystem * Forward-looking statements for the direction of the Iceberg e

Re: Clarification on DayTransform Result Type

d3e3cb15b1712f3a1db473ca940/api/src/main/java/org/apache/iceberg/types/Type.java#L37 >> >> On Thu, Sep 26, 2024 at 8:38 PM Kevin Liu wrote: >> >>> Hey folks, >>> >>> While reviewing a PR to fix DayTransform in PyIceberg (#1208 >>> <https://githu

Clarification on DayTransform Result Type

Hey folks, While reviewing a PR to fix DayTransform in PyIceberg (#1208 ), we found an inconsistency between the spec and the Java Iceberg library. According to the spec , the result type fo

Re: [Notice] Update to catalog sync meeting timezone 2

https://docs.google.com/document/d/1iPGVCIcr-M0XtAiudOguWAvmqIdVgpYN5vz5ohO8PKw/edit This doc includes the calendar for the catalog sync and notes from past syncs. Best, Kevin Liu On Tue, Sep 24, 2024 at 8:15 AM Sung Yun wrote: > Hi Jack Ye, thank you for the update ! > > This may b

  1   2   >