Re: Welcome Huaxin Gao as a committer!

Congratulations Huaxin! On Thu, Feb 6, 2025 at 10:32 AM John Zhuge wrote: > Congratulations Huaxin! > > On Thu, Feb 6, 2025 at 9:52 AM Huang-Hsiang Cheng > wrote: > >> Congratulations Huaxin! >> >> Huang-Hsiang >> >> On Feb 6, 2025, at 9:32 AM, Wing Yew Poon >> wrote: >> >> Congratulations Hua

Re: [VOTE] Update partition stats spec for V3

+1 On Mon, Feb 3, 2025 at 11:42 PM Ajantha Bhat wrote: > +1 > > On Tue, Feb 4, 2025 at 11:30 AM Eduard Tudenhöfner < > etudenhoef...@apache.org> wrote: > >> +1 >> >> On Mon, Feb 3, 2025 at 8:33 PM Dongjoon Hyun wrote: >> >>> +1 for the proposal. >>> >>> Dongjoon >>> >>> > On Mon, Feb 3, 2025 at

Re: [DISCUSS/VOTE] Add in ChangeLog Reserved Field IDs to Spec and Decrement Row Lineage Reserved IDs

+1, thanks for driving this! Best Regards, Honah On Sun, Jan 26, 2025 at 3:20 PM Steven Wu wrote: > +1 > > On Sun, Jan 26, 2025 at 3:01 PM John Zhuge wrote: > >> +1 (non-binding) >> >> John Zhuge >> >> >> On Sun, Jan 26, 2025 at 2:59 PM Aihua Xu wrote: >> >>> +1 (non-binding). >>> >>> Thanks

Re: [VOTE] Add initial/write defaults to REST spec

+1, thanks for driving this! Best Regards, Honah On Fri, Jan 24, 2025 at 3:50 PM rdb...@gmail.com wrote: > +1 > > On Fri, Jan 24, 2025 at 2:25 PM Yufei Gu wrote: > >> +1 >> Yufei >> >> >> On Fri, Jan 24, 2025 at 2:15 PM Amogh Jahagirdar <2am...@gmail.com> >> wrote: >> >>> +1 (binding) >>> >>>

Re: [VOTE] Document Snapshot Summary Optional Fields as Subsection of Appendix F in Spec

d, Jan 22, 2025 at 7:57 AM Kevin Liu wrote: > >> +1 non-binding >> >> Third time's the charm! :) >> >> On Wed, Jan 22, 2025 at 4:44 AM Jean-Baptiste Onofré >> wrote: >> >>> +1 (non binding) >>> >>> Regards >>> JB &

Re: [VOTE] REST API changes for freshness-aware table loading

+1, thanks Gabor! Best regards, Honah On Fri, Jan 24, 2025 at 12:30 PM Russell Spitzer wrote: > +1 'd on the PR earlier, but for the record +1 here as well :) > > On Fri, Jan 24, 2025 at 1:57 PM rdb...@gmail.com wrote: > >> +1 >> >> Thanks, Gabor! >> >> On Fri, Jan 24, 2025 at 9:25 AM Christia

Re: [DISCUSS, VOTE] OpenAPI Metadata Update for EnableRowLineage

+1, thanks Russell! Best regards, Honah On Wed, Jan 22, 2025 at 6:49 PM Renjie Liu wrote: > +1, thanks Russell for driving this! > > On Thu, Jan 23, 2025 at 8:12 AM Russell Spitzer > wrote: > >> That was a bit of what we discussed at the sync this morning. Whether we >> should have a generic e

Re: Reminder: Iceberg Catalog Community Sync

anish > > On Tue, Jan 21, 2025 at 2:23 PM Honah J. wrote: > >> Hi everyone, >> >> FYI, the first catalog community sync in 2025 will be on tomorrow, >> Wednesday 01/22 at 9AM (US/Pacific). Here is the meeting note/recordings: >> >> https://docs.google.com

Reminder: Iceberg Catalog Community Sync

Hi everyone, FYI, the first catalog community sync in 2025 will be on tomorrow, Wednesday 01/22 at 9AM (US/Pacific). Here is the meeting note/recordings: https://docs.google.com/document/d/1iPGVCIcr-M0XtAiudOguWAvmqIdVgpYN5vz5ohO8PKw/edit?tab=t.0#heading=h.cr6o1g2rn5hc Please feel free to add topi

[VOTE] Document Snapshot Summary Optional Fields as Subsection of Appendix F in Spec

Hi everyone, In the last VOTE thread on documenting snapshot summary optional fields, we decided to move the documentation to a subsection of Appendix F – Implementation Notes. Since this is a significant change, I canceled the pre

Re: [VOTE] Deprecate IRC snapshot-id Field of SetStatisticsUpdate

+1 Thanks Christian! Best regards, Honah On Tue, Jan 21, 2025 at 10:54 AM Yufei Gu wrote: > +1 Thanks for removing the redundant! > Yufei > > > On Tue, Jan 21, 2025 at 9:28 AM Jean-Baptiste Onofré > wrote: > >> +1 (non binding) >> >> Thanks Christian ! >> >> Regards >> JB >> >> On Tue, Jan 21,

Re: [Discuss][Vote] Spec Change - Add optional field added-rows to Snapshot for Row Lineage

+1 Best, Honah On Thu, Jan 16, 2025 at 22:54 Manish Malhotra < manish.malhotra.w...@gmail.com> wrote: > +1, thanks Russel! > this will help other engines as well. > > > Thanks, > Manish > > On Thu, Jan 16, 2025 at 3:15 PM Amogh Jahagirdar <2am...@gmail.com> wrote: > >> I'm +0. I definitely agree

Re: [VOTE] Document Snapshot Summary Optional Fields as Appendix in Spec

Hi everyone, Thank you for your votes and valuable suggestions. I have updated the PR to remove the statement, "Metrics must be accurate if written," and have relocated the relevant documentation to Appendix F - Implementation Notes. Updated PR: https://github.com/apache/iceberg/pull/11660 Given

[VOTE] Document Snapshot Summary Optional Fields as Appendix in Spec

Hi everyone, Based on good feedback on the [DISCUSS] thread . and the pull request . I would like to raise a vote to add documentation of snapshot summary optional

Re: [DISCUSS] Use pr title + pr description as default git commit title + message in iceberg-rust

Hi everyone, +1 I remember that I manually copy-pasting PR descriptions into merge commit messages multiple times. PRs often accumulate numerous commits during reviews, resulting in overly lengthy and less useful commit messages. Using the PR description as the default merge commit message seems

Re: [Discuss] Document Snapshot Summary Optional Fields for Standardization

cument/d/1Gt1ZOXVXK60IGdlmt4QlyRzaZ1iCVyYUBfMJCsiz14I/edit?usp=sharing> - PR #11660 <https://github.com/apache/iceberg/pull/11660> Please take a moment to review them when you have the chance, and feel free to share any thoughts or questions you may have. Best regards, Honah On Tue, Dec 17, 2024 at 10:02 P

Re: [Discuss] Document Snapshot Summary Optional Fields for Standardization

ralized place to view all possible >> key/value pairs, similar to how FileIO configuration is handled in >> iceberg-python. Other implementations can use this table as a reference. >> >>> >> >>> > This approach offers flexibility, as new fields can be added

Re: New committer: Scott Donnelly

Congratulations, Scott! On Tue, Dec 10, 2024 at 7:26 PM Renjie Liu wrote: > Hey everyone, > > The Project Management Committee (PMC) for Apache Iceberg has > invited Scott Donnelly to become a committer. Scott did a lot of impressive > work in iceberg-rust, and we are pleased to announce that he

Re: New committer: Matt Topol

Congratulations, Matt! On Tue, Dec 10, 2024 at 7:51 PM Fenil Jain wrote: > Congratulations Matt! > > On Tue, Dec 10, 2024 at 3:56 PM Fokko Driesprong wrote: > > > > Hey everyone, > > > > The Project Management Committee (PMC) for Apache Iceberg has invited > Matt Topol to become a committer. Ma

Re: [VOTE] Release Apache Iceberg 1.7.1 RC1

+1 (binding) Bryan, thanks for running the release! Verified signature/checksum/license. Built against JDK17. Kevin, thanks for the update and explanation! Best regards, Honah On Tue, Dec 3, 2024 at 7:35 PM Kevin Liu wrote: > Hey everyone, > > I wanted to follow up on the issue I encountered

Re: [VOTE] Release Apache PyIceberg 0.8.1rc1

+1 (binding) Thanks for running the release, Kevin! - Verified signatures/checksum/license - Ran tests "make test-coverage" in python 3.11 I noticed that when running tests with latest dependencies: - pandas==2.2.3 - pyspark==3.5.4 - getdaft==0.3.15 some tests failed due to the following warning

Re: [DISCUSS] Apache Iceberg Summit 2025 - Selection Committee

Thanks JB! I am very excited about this and happy to help. Best regard, Honah On Tue, Nov 26, 2024 at 2:15 PM Steven Wu wrote: > happy to help. > > On Tue, Nov 26, 2024 at 12:01 PM John Zhuge wrote: > >> Happy to help in any way I can. >> >> On Tue, Nov 26, 2024 at 11:03 AM Jack Ye wrote: >>

[Discuss] Document Snapshot Summary Optional Fields for Standardization

Hi everyone, I’d like to propose an addition to the table specification to document optional fields in the snapshot summary. Currently, the snapshot summary includes a required operation field and various optional fields. While these optional fields—such as metrics and partition-level summaries—a

[Discuss] Proposal to Adjust Catalog Sync Schedule & Cancel Next Wednesday’s Meeting

Hi everyone, Thank you all for your participation in the catalog community sync so far! I'm writing to discuss changes to the meeting schedule to better fit everyone's availability and make our discussions more productive. Here’s a quick summary of the current cadence

Re: Changing Ownership and Cadence for Catalog Community Sync

Thanks Jack! Hi everyone, I am very happy to help host the meeting series. Just a quick heads up that tomorrow's Iceberg Catalog Community Sync (Nov 20 9:00 am - 10:00am PST) meeting will proceed as usual. I will create a new event series in the same calendar soon. Best regards, Honah On Tue, No

Re: [VOTE] Deprecate and remove last-column-id

+1. Thanks Fokko. Best, Honah On Tue, Nov 19, 2024 at 9:11 AM Kevin Liu wrote: > +1 (non-binding). The spec and code deprecation schedule looks good to me. > > Best, > Kevin Liu > > On Tue, Nov 19, 2024 at 8:42 AM Christian Thiel > wrote: > >> +1 (non-binding) – looks like we are going in the

Re: [VOTE] Release Apache PyIceberg 0.8.0rc2

+1 (binding) Thanks for running the release! - Verified signatures/checksum/license - Ran tests "make test-coverage" in python 3.11 Best regards, Honah On Fri, Nov 15, 2024 at 7:46 AM Fokko Driesprong wrote: > +1 binding > > Thanks for running this release! Checked the signatures, checksums,

Re: [VOTE] Release Apache PyIceberg 0.8.0rc1

+1 (binding) Thanks for running the release! - Verified signatures/checksum/license - Ran tests "make test-coverage" in python 3.11 Best regards, Honah On Sat, Nov 9, 2024 at 2:40 PM Fokko Driesprong wrote: > +1 (binding) > > Thanks for running this release Kevin! > > - Verified signatures an

Re: [VOTE] Release Apache Iceberg 1.7.0 RC0

+1 (binding) Verified signature/checksum/license/build/test with JDK17 Best regards, Honah On Sun, Nov 3, 2024 at 10:47 AM Cheng Pan wrote: > FYI, I just identified a Parquet data loss issue(newly introduced in > 1.14.0), and I confirmed it affects the Spark use cases, I’m not sure if it > als

Re: [DISCUSS] Iceberg Summit 2025 ?

+1 on hosting another Iceberg Summit in 2025! We had many great talks last time, and I think it will be even better if we can have a hybrid mode this time, as the in-person element can add value for deeper engagement and networking. I’m particularly interested in incorporating workshops. We could

Re: [VOTE] Release Apache PyIceberg 0.7.1rc2

+1 (binding) - Validated signatures/checksum/license - Ran test with Python 3.11.9 Sorry for being late. Thanks Sung for running the release! Thanks everyone for contributing and testing! Best regards, Honah On Fri, Aug 16, 2024 at 5:04 PM Sung Yun wrote: > Hi folks! > > We are 1 binding vote

Re: [DISCUSS] Use iceberg-rust as pyiceberg file io

Thanks Xuanwo for driving this and everyone for discussing, I like the idea of pushing down low-level logic to Iceberg-rust (pyiceberg_core). It’s great to have another option besides PyArrow for reading and writing data in PyIceberg. Thanks, Xuanwo, for moving this forward with the initial PR to

Re: [ANNOUNCE] Apache PyIceberg release 0.7.0

Thanks Sung for running the release and thanks everyone for contributing! This is a great milestone for PyIceberg! Best regards, Honah On Tue, Jul 30, 2024 at 10:47 PM Renjie Liu wrote: > Thanks Sung for driving the release, and all contributors! > > On Wed, Jul 31, 2024 at 1:35 PM Fokko Driesp

Re: [VOTE] Release Apache PyIceberg 0.7.0rc2

+1 (binding) - Validated signatures/checksums/license - Ran tests (make test-coverage) in Python3.11 - Ran Glue integration tests Thank you Sung for running the release and thanks everyone for testing and voting. Best regards, Honah On Mon, Jul 29, 2024 at 5:36 PM André Luis Anastácio

Re: [ANNOUNCE] Welcoming new committers and PMC members

Thank you all! Congratulations to Kevin, Piotr, Sung, Xuanwo, and Renjie! It’s truly an honor to contribute to the project and witness the incredible growth of our community. I’m excited to continue working together and help drive the project to new heights! On Tue, Jul 23, 2024 at 7:24 PM Renjie

Re: [VOTE] Release Apache Iceberg 1.6.0 RC0

+1 (non-binding) - verified signature and checksum - verified license doc - verified build and tests with JDK 17 Best regards, Honah On Tue, Jul 16, 2024 at 10:40 PM Ajantha Bhat wrote: > Gentle reminder for the PMC members, we need at least two additional >> binding votes. > > > One

Re: [DISCUSS] Enable the discussion tab for iceberg github repos

+1 for enabling it on iceberg-rust first. IMO, this can benefit many code-related discussions. GitHub provides a convenient way for users to point out specific parts of the source code by pasting the permalink, which GitHub automatically renders. Looking forward to seeing how this progresses in ic

Re: [VOTE] Fix property names in REST spec for statistics / partition statistics

+1 (non-binding) Best regards, Honah On Wed, Jul 10, 2024 at 1:19 PM Péter Váry wrote: > +1 (non-binding - at least as a committer I think I have a non-binding > vote :) ) > > On Wed, Jul 10, 2024, 20:14 Ryan Blue wrote: > >> +1 >> >> On Wed, Jul 10, 2024 at 10:09 AM Ajantha Bhat >> wrote: >>

Re: [VOTE] spec: remove the JSON spec for content file and file scan task sections

+1 (non-binding) Thanks, Steven! Best regards, Honah On Thu, Jul 11, 2024 at 2:39 PM Kevin Liu wrote: > +1 (non-binding) > > Thanks, > Kevin Liu > > On Thu, Jul 11, 2024 at 12:00 PM Szehon Ho > wrote: > >> +1 >> >> Thanks >> Szehon >> >> On Thu, Jul 11, 2024 at 11:02 AM Daniel Weeks wrote: >

Re: [DISCUSS] Formalized File IO Properties

Hello everyone, Thank you all for the valuable insights. I am also +1 on having standardized names for File IO properties. Creating a dedicated section to summarize property names in the Java implementation is a good starting point. Since pyiceberg, icebergRust, and IcebergGolang will support only

Re: Feedback Collection: Bylaws in Iceberg

Hi everyone, Thanks to everyone for the valuable points raised recently. I’m in favor of having bylaws that contain details on how the Iceberg community works, especially regarding “Decisions,” as this will provide clarity and guidance for all members. I would like to share some of my thoughts o

[ANNOUNCE] Apache PyIceberg release 0.6.1

I'm pleased to announce the release of Apache PyIceberg 0.6.1! Apache Iceberg is an open table format for huge analytic datasets. Iceberg delivers high query performance for tables with tens of petabytes of data, along with atomic commits, concurrent writes, and SQL-compatible table evolution. Th

Re: [VOTE] Release Apache PyIceberg 0.6.1rc3

ntegration tests. >> >> Warm regards, >> Mehul Batra >> >> On Mon, Apr 22, 2024 at 12:41 AM Honah J. wrote: >> >>> +1 (non-binding) >>> >>> - Verified signatures and checksums >>> - Verified license >>> - Ran unit tests

Re: [VOTE] Release Apache PyIceberg 0.6.1rc3

n to 3.4.3 <https://github.com/apache/iceberg-python/pull/622>. The error is because the release of Spark 3.4.3 makes the download url of 3.4.2 break. Best regards, Honah On Sun, Apr 21, 2024 at 8:43 AM Jean-Baptiste Onofré wrote: > +1 (non binding) > > Regards > JB > > Le

[VOTE] Release Apache PyIceberg 0.6.1rc3

Hi Everyone, I propose that we release the following RC as the official PyIceberg 0.6.1 release. This is a patch release due to the following bugs: - Fail to create version 1 table with non-empty partition-spec and sort-order - Hive Ca

Re: [VOTE] Release Apache PyIceberg 0.6.1rc2

; some of the dependencies: >>> >>> make install >>> Updating dependencies >>> Resolving dependencies... (3.1s) >>> >>> Package docutils (0.21.post1) not found. >>> make: *** [install-dependencies] Error 1 >>> >>> I fou

[VOTE] Release Apache PyIceberg 0.6.1rc2

Hi Everyone, I propose that we release the following RC as the official PyIceberg 0.6.1 release. This is a patch release due to the following bugs: - Fail to create version 1 table with non-empty partition-spec and sort-order - Hive Ca

Re: [VOTE] Release Apache PyIceberg 0.6.1rc1

Hi everyone, Thanks for all the votes and all the discussions around LICENSE and NOTICE. We really appreciate all the effort. I would like to cancel this RC due to another issue: - Hive Catalog cannot create table with TimestamptzType field · Issue #583

Re: [VOTE] Release Apache PyIceberg 0.6.1rc1

Hi Justin, Thanks for reviewing the release. There were some discussions about the NOTICE file in the 0.6.0 release: PR#410 and PR#413 . Here are the reasons why the following projects have not b

Re: [VOTE] Release Apache PyIceberg 0.6.1rc1

+1 (non-binding) - Verified signatures and checksums - Verified license - Ran unit tests and integration tests Best regards, Honah On Tue, Apr 2, 2024 at 9:45 AM Honah J. wrote: > Hi Everyone, > > I propose that we release the following RC as the official PyIceberg 0.6.1 > relea

[VOTE] Release Apache PyIceberg 0.6.1rc1

Hi Everyone, I propose that we release the following RC as the official PyIceberg 0.6.1 release. This is a patch release due to a serious bug that has been found . Smaller bugs also have been backported

[Proposal] PyIceberg 0.6.1 patch release

Hi everyone, This week we've discovered a serious bug that causes pyiceberg fail to create version 1 table with non-empty partition-spec and sort-order . According to the discussion in today's iceberg python sync meeting, we plan to do a quick pat

Re: New committer: Renjie Liu

Congratulations Renjie! Best, Honah On Thu, Mar 14, 2024 at 10:23 PM Jun H. wrote: > Congratulations! > > > On Mar 14, 2024, at 1:53 PM, Bryan Keller wrote: > > Belated congrats! > > On Mar 11, 2024, at 1:04 PM, Steve Zhang > wrote: > > Congrats Renjie! > > Thanks, > Steve Zhang > > > > On M

Re: New committer: Bryan Keller

Congratulations Bryan! On Tue, Mar 5, 2024 at 1:40 AM Ajantha Bhat wrote: > Congratulations Bryan. > > On Tue, Mar 5, 2024 at 2:50 PM Eduard Tudenhoefner > wrote: > >> Congrats Bryan, very well deserved! >> >> On Tue, Mar 5, 2024 at 9:37 AM Hussein Awala wrote: >> >>> Congrats Bryan! >>> >>> O

Re: [VOTE] Release Apache PyIceberg 0.6.0rc6

+1 (non-binding) - Verified signatures and checksums - Verified license - Ran unit tests and integration tests Best regards, Honah On Sun, Feb 18, 2024 at 2:54 PM Daniel Weeks wrote: > +1 (binding) > > Verified sigs/sums/license/tests (python 3.11) > > Also ran local tests against Hive and RES

Re: [VOTE] Release Apache PyIceberg 0.6.0rc4

+1 (non-binding) - Verified signatures and checksums - Verified license - Ran unit tests and integration tests Thanks to Sung for preparing the release, and a big thank you to everyone who contributed to pyiceberg 0.6.0 Best regards, Honah On Thu, Feb 8, 2024 at 6:28 AM Sung Yun (BLOOMBERG/ 120

Re: [Discuss] Change iceberg-python and iceberg-go CI Settings to only require approval for first time contributors

gt;> On Fri 2. Feb 2024 at 04:56 Drew wrote: >> >>> +1 >>> >>> Thanks for bringing this up for PyIceberg Honah >>> >>> On Thu, Feb 1, 2024 at 5:35 PM Honah J. wrote: >>> >>>> Hello everyone >>>> >>>> Inspi

[Discuss] Change iceberg-python and iceberg-go CI Settings to only require approval for first time contributors

Hello everyone Inspired by our recent discussion regarding iceberg-rust's CI setting, I am starting this thread to gather feedback on changing the CI settings for iceberg-python and iceberg-go to only require approvals for new contributors. I think this will benefit contributors and align CI sett

Re: [DISCUSS] Change iceberg-rust CI Settings to only require approval for new github users

+1! I'll initiate a separate thread to discuss implementing a similar approach for iceberg-python and iceberg-go On Wed, Jan 31, 2024 at 7:02 PM Jack Ye wrote: > +1! And I think we should also do that for iceberg-go > > -Jack > > On Wed, Jan 31, 2024, 5:42 PM Renjie Liu wrote: > >> +1 for thi

Re: [DISCUSS] PyIceberg 0.6.0 release

Really excited for the upcoming 0.6.0 release and its new features! Big thanks to everyone for their hard work. I'm looking forward to the community feedback and future enhancements. Best regards, Honah On Fri, Jan 26, 2024 at 1:56 PM Daniel Weeks wrote: > I'm also strongly in favor of getting