Re: [VOTE] Release Apache PyIceberg 0.8.1rc1

2024-12-03 Thread Fokko Driesprong
+1 (binding) Checked checksums, signatures, and licenses. Honah, there are some open PRs to bump to the latest dependencies (e.g. Pandas 2.2.3 ), except for the warning, everything works well. Would be good to get those bumped at some point :)

Re: [Proposal] Automating the PyIceberg Release Process

2024-12-04 Thread Fokko Driesprong
o push the artifacts. I can generate a new PyPI token using > my own PyPI account, or we could request one from ASF Infra. > > Thanks again for your help! > > Best, > Kevin Liu > > [1] https://reproducible-builds.org/ > [2] https://github.com/wimglenn/setuptools-reproducibl

Re: [ANNOUNCE] Release Apache Iceberg Rust v0.4.0

2024-12-23 Thread Fokko Driesprong
Thanks for driving this release, Sung, and thanks to everyone who contributed! Kind regards, Fokko Op di 24 dec 2024 om 05:22 schreef Xuanwo : > Thank you for building this release! > > Really nice gift. > > On Tue, Dec 24, 2024, at 11:53, Sung Yun wrote: > > Hi all, > > > > The Apache Iceberg R

Re: Welcome Huaxin Gao as a committer!

2025-02-06 Thread Fokko Driesprong
Congratulations Huaxin! Op do 6 feb 2025 om 12:21 schreef Russell Spitzer : > Congratulations! > > On Thu, Feb 6, 2025 at 11:35 AM Péter Váry > wrote: > >> Congratulations! >> >> Matt Topol ezt írta (időpont: 2025. febr. 6., >> Cs, 10:40): >> >>> Congrats! Welcome! >>> >>> On Thu, Feb 6, 2025,

Re: [DISCUSS] Apache Iceberg (java) 1.8.0 release

2025-02-10 Thread Fokko Driesprong
That shouldn't be included. There is still active discussion on the PR, and it needs more work. The author also removed the milestone. The VOTE is out, so we can start verifying. Kind regards, Fokko Op ma 10 feb 2025 om 05:41 schreef Manu Zhang : > There's still https://github.com/apache/iceberg

Re: [DISCUSS] Apache Iceberg (java) 1.8.0 release

2025-02-10 Thread Fokko Driesprong
to > 1.8.0 either? > > Regards, > Manu > > On Mon, Feb 10, 2025 at 4:36 PM Fokko Driesprong wrote: > >> That shouldn't be included. There is still active discussion on the PR, >> and it needs more work. The author also removed the milestone. The VOTE is >> out, so

Re: [VOTE] Deprecate or remove distinct_count

2025-02-11 Thread Fokko Driesprong
My mistake, I suggested sending out an email with a quick vote on the PR. I like the suggestion to use this thread for discussion since the number of options is limited. I'm in favor of deprecating the field, to avoid that we re-use the field-id in the future. Kind regards, Fokko Op di 11 feb 20

Re: [VOTE] Add RemoveSchemas update type to REST spec

2025-02-11 Thread Fokko Driesprong
+1 Op di 11 feb 2025 om 13:52 schreef Jean-Baptiste Onofré : > +1 (non binding) > > Regards > JB > > On Tue, Feb 11, 2025 at 3:38 AM Gabor Kaszab > wrote: > > > > Hi Iceberg Community, > > > > I'm working on removing the unused schemas from the table metadata when > running snapshot expiration.

Re: guideline for interface change

2025-02-02 Thread Fokko Driesprong
Hey Aihua, Late to the party here, but the docs on deprecation can be found here: https://iceberg.apache.org/contribute/#semantic-versioning Hope this helps! Kind regards, Fokko Op zo 2 feb 2025 om 21:12 schreef Aihua Xu : > Thanks folks for suggestions. I will keep the existing one and mark it

Re: New committer: Scott Donnelly

2024-12-11 Thread Fokko Driesprong
Congratulations Scott! Kind regards, Fokko Op wo 11 dec 2024 om 11:56 schreef Manu Zhang : > Congratulations Scott! > > Thanks, > Manu > > On Wed, Dec 11, 2024 at 3:21 PM Eduard Tudenhöfner < > etudenhoef...@apache.org> wrote: > >> Congrats Scott! >> >> On Wed, Dec 11, 2024 at 7:35 AM roryqi wr

Re: [Discussion] Maintain vendor neutrality on the quickstart page

2024-12-10 Thread Fokko Driesprong
Hey Ajantha, Thanks for bringing this up, we should both remove the vendor reference and bring this back up to date. My preference would be to rely on the Spark image provided by the Apache Spark project, similar to what we do for the Hive

New committer: Matt Topol

2024-12-10 Thread Fokko Driesprong
in our project community. Fokko Driesprong On behalf of the Iceberg PMC

Re: [Discussion] Maintain vendor neutrality on the quickstart page

2024-12-10 Thread Fokko Driesprong
di 10 dec 2024 om 11:48 schreef Ajantha Bhat : > That's a good suggestion Fokko. > It would avoid maintaining one more docker image. We can update the > quickstart to use the docker image provided by Spark. > > - Ajantha > > On Tue, Dec 10, 2024 at 4:08 PM Fokko Drie

Re: [Discuss] Document Snapshot Summary Optional Fields for Standardization

2024-12-16 Thread Fokko Driesprong
I'm in favor of this as well. While working on PyIceberg I had to deduce this from the Java code, having a more condensed version in the appendix of the spec would be great. Kind regards, Fokko Op ma 16 dec 2024 om 14:21 schreef Jean-Baptiste Onofré : > Hi, > > yes I agree, I don't think we have

Re: [DISCUSS] Remove snapshot-id from IRC SetStatisticsUpdate

2024-12-16 Thread Fokko Driesprong
Hey Christian, Great catch, I would also be in favor of removing the outer one. I don't see any value in having them both. Kind regards, Fokko Op ma 16 dec 2024 om 14:26 schreef Jean-Baptiste Onofré : > Hi, > > I saw the discussion on Slack. Yeah, it's redundant. > I know some catalogs only con

Re: 1.7.1 breaking change related to ADLS support

2024-12-17 Thread Fokko Driesprong
Thanks for raising this Alex, I suggest doing a 1.7.2 patch release since we don't want to leave the 1.7.x version in a broken state for the ADLSFileIO. Kind regards, Fokko Op di 17 dec 2024 om 07:40 schreef Jean-Baptiste Onofré : > Hi Alex, > > It was exactly my concern (and question) when I d

Re: 1.7.1 breaking change related to ADLS support

2024-12-17 Thread Fokko Driesprong
I took the liberty of creating a 1.7.2 milestone: https://github.com/apache/iceberg/milestone/52 Kind regards, Fokko Op di 17 dec 2024 om 09:58 schreef Fokko Driesprong : > Thanks for raising this Alex, > > I suggest doing a 1.7.2 patch release since we don't want to leave the &

Re: REST catalog high availability

2024-12-18 Thread Fokko Driesprong
Hey Vladimir, Thanks for raising this thread. I'm also reluctant to add this to the application layer. We would also need to support this with the other clients that are out there. Did you give JB's suggestion around the PoolingHttpClientConnectionManager a try? Kind regards, Fokko Op di 17 dec

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC2

2024-12-18 Thread Fokko Driesprong
Hey Kevin, Ran into the same thing :) Currently, the tests don't support Docker , I've switched to Podman and it works like a charm. Kind regards, Fokko Op wo 18 dec 2024 om 16:46 schreef Kevin Liu : > Hey Sung, > > Thanks fo

Re: ​[discuss] Allow 200 responses for HEAD requests in REST API

2024-12-18 Thread Fokko Driesprong
Hey Kevin, I also agree with Yufei. For PyIceberg we had a long list of issues around the head request (#1363 gives a nice overview) to check if the table is there (and that also has just been added to Java

Re: [DISCUSS] Spec change to fix snapshot-logs reset issue when replacing tables in REST catalog

2024-12-19 Thread Fokko Driesprong
Hey Yuya, Thanks for raising this. When possible, I'd like to avoid additional flags to avoid confusion. For example, in the PR the purge flag is only taken into account when you remove the main ref. I would be leaning towards keeping the snapshot-log, instead of purging it. The snapshot-log will

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC2

2024-12-19 Thread Fokko Driesprong
Hey everyone, Unfortunately -1 (binding) from my end. It looks like we're able to read tables with merge-on-read deletes and we silently ignore them. This leads to data correctness issues and should be fixed before releasing it to the public. See #826

Re: [VOTE] Deprecate and remove last-column-id

2024-11-21 Thread Fokko Driesprong
llowing minor release (1.8.x), the removal from the code is staged for the next minor (1.9.x) or major release (2.x.x), and the removal from the spec is planned for (2.x.x). Hope this clarifies. Kind regards, Fokko Driesprong Op di 19 nov 2024 om 10:45 schreef Manu Zhang : > Thanks Fokko.

Re: [DISCUSS] Proposal to buffer manifest files before updating manifest-list

2024-11-22 Thread Fokko Driesprong
Hi Jan, Thanks for sending out this proposal. While reading through it, two questions pop up: - You mentioned repurposing the manifests field. Currently, this field contains a list of paths that point to the manifest data. Would this also be your suggestion? This way, when committing the

Re: [DISCUSS] Deprecate embedded manifests

2024-11-22 Thread Fokko Driesprong
gt; of concurrent writes. > > I've written down my proposal here: > https://lists.apache.org/thread/4cm9kc6pkmx5ol218z5yjk41gh9t28qg > > And I thought I share it with you before you decide to deprecate the > manifests field. > > Kind regards, > > Jan > On 22.11.24

Re: [PROPOSAL] Create Iceberg DockerHub repository

2024-11-22 Thread Fokko Driesprong
. >> > We already found a bug in PyIceberg [1] from integrating with the TCK >> docker image. It would be great to have a nightly build, perhaps we can set >> up a Github Action to automate the docker image publishing. >> > >> > Best, >> > Kevin Liu &g

Re: [VOTE] Deprecate IRC snapshot-id Field of SetStatisticsUpdate

2025-01-21 Thread Fokko Driesprong
+1 Thanks for cleaning this up Christian! Kind regards, Fokko Op di 21 jan 2025 om 08:25 schreef Christian Thiel < christian.t.b...@gmail.com>: > Hi everyone, > > based on good feedback on the [DISCUSS] thread [1] I would like to raise > a vote to deprecate the `snapshot-id` field of the `SetSt

Re: [DISCUSS, VOTE] OpenAPI Metadata Update for EnableRowLineage

2025-01-23 Thread Fokko Driesprong
+1 Thanks Russell Op do 23 jan 2025 om 18:47 schreef Aihua Xu : > + (non binding). > > Thanks Russell. > > On Thu, Jan 23, 2025 at 2:05 AM Jean-Baptiste Onofré > wrote: > >> +1 (non binding) >> >> Regards >> JB >> >> On Wed, Jan 22, 2025 at 11:51 PM Russell Spitzer >> wrote: >> > >> > Hey Y'al

Re: [DISCUSS] Apache Iceberg (java) 1.8.0 release

2025-01-24 Thread Fokko Driesprong
Added! +1 on the more frequent releases! Kind regards, Fokko Op za 25 jan 2025 om 02:01 schreef Dmitri Bourlatchkov : > Thanks for the clarification, Amogh! Much appreciated! > > Would you mind adding these PRs to the 1.9 milestone, please? > > https://github.com/apache/iceberg/pull/11992 > htt

Re: [VOTE] Add initial/write defaults to REST spec

2025-01-24 Thread Fokko Driesprong
+1 Op za 25 jan 2025 om 00:55 schreef Honah J. : > +1, thanks for driving this! > > Best Regards, > Honah > > On Fri, Jan 24, 2025 at 3:50 PM rdb...@gmail.com wrote: > >> +1 >> >> On Fri, Jan 24, 2025 at 2:25 PM Yufei Gu wrote: >> >>> +1 >>> Yufei >>> >>> >>> On Fri, Jan 24, 2025 at 2:15 PM Amo

Re: [VOTE] REST API changes for freshness-aware table loading

2025-01-24 Thread Fokko Driesprong
+1 I think this is an elegant solution, thanks for working on this Gabor! Kind regards, Fokko Op vr 24 jan 2025 om 21:31 schreef Honah J. : > +1, thanks Gabor! > > Best regards, > Honah > > On Fri, Jan 24, 2025 at 12:30 PM Russell Spitzer < > russell.spit...@gmail.com> wrote: > >> +1 'd on the

Re: [discuss] Standardizing Naming Schemes for Language-Specific Configurations

2025-01-24 Thread Fokko Driesprong
We formalized some of the configurations in the REST spec . Still, I would be reluctant to try to create an exhaustive list of configuration options since it will be tough to m

Re: [DISCUSS/VOTE] Add in ChangeLog Reserved Field IDs to Spec and Decrement Row Lineage Reserved IDs

2025-01-27 Thread Fokko Driesprong
+1 Op ma 27 jan 2025 om 10:54 schreef Honah J. : > +1, thanks for driving this! > > Best Regards, > Honah > > On Sun, Jan 26, 2025 at 3:20 PM Steven Wu wrote: > >> +1 >> >> On Sun, Jan 26, 2025 at 3:01 PM John Zhuge wrote: >> >>> +1 (non-binding) >>> >>> John Zhuge >>> >>> >>> On Sun, Jan 26, 2

Re: [VOTE] Release Apache Iceberg 1.7.2 rc0

2025-01-26 Thread Fokko Driesprong
Hey Ajantha, As mentioned in the 1.7.2 DISCUSS thread, we don't want to leave the 1.7.x version in a broken state. Since the 1.8.x ships with new features, it will require more thorough testing. I still think it would be good to get 1.7.2 to the public ASAP. Kind regards, Fokko Op ma 27 jan 2025

Re: [VOTE] Release Apache Iceberg 1.7.2 rc0

2025-01-27 Thread Fokko Driesprong
93550 gpg: Good signature from "Fokko Driesprong " [unknown] gpg: WARNING: This key is not certified with a trusted signature! gpg: There is no indication that the signature belongs to the owner. Primary key fingerprint: FCD3 779E 399C 53D9 95FC 82A3 5171 BA3E 5449 3550 *➜

Re: Very strange (AI generated) issues

2025-01-22 Thread Fokko Driesprong
Hey Jarek, Thanks for bringing this to our attention. When you talk about flooding, how many are we talking about? I see some suspicious issues (eg, here ), but not many. I hope this will come to a halt soon because it all additional work, and we als

Re: [VOTE] Document Snapshot Summary Optional Fields as Subsection of Appendix F in Spec

2025-01-22 Thread Fokko Driesprong
+1 Op wo 22 jan 2025 om 08:21 schreef Péter Váry : > +1 > > On Wed, Jan 22, 2025, 06:06 huaxin gao wrote: > >> +1 (non-binding) >> >> On Tue, Jan 21, 2025 at 6:04 PM Manu Zhang >> wrote: >> >>> +1 (non-binding) >>> >>> Thanks & Regards >>> >>> On Wed, Jan 22, 2025 at 8:06 AM Daniel Weeks wrote

Re: Very strange (AI generated) issues

2025-01-22 Thread Fokko Driesprong
useless takes a lot of time. This is part of the problem, that it takes a >> lot of energy and time to determine if those are valid or not - and with >> such a rate, it's not sustainable just to analyze whether they are good or >> bad. >> >> J. >> >>

[DISCUSS] Apache Iceberg 1.7.2 release

2025-01-12 Thread Fokko Driesprong
Hi everyone, Over the weekend the last item from the 1.7.2 milestone has been resolved. I took the liberty of cherry-picking the commits to the 1.7.x branch

Re: [DISCUSS] Apache Iceberg 1.7.2 release

2025-01-14 Thread Fokko Driesprong
7;m also fine either way for the release manager, I can tackle it > (with you) or you do, everything is fine for me :) > > Thanks ! > Regards > JB > > On Mon, Jan 13, 2025 at 7:24 AM Fokko Driesprong wrote: > > > > Hi everyone, > > > > Over the weekend

Re: [VOTE] Release Apache Iceberg Rust 0.4.0 RC3

2024-12-23 Thread Fokko Driesprong
+1 binding - Checked signature and checksum - Checked licenses - Ran test suite and verify.py - Did some local testing Thanks for running this release Sung, and anyone who contributed to this release. Very excited to see this next milestone for Iceberg-Rust. Kind regards, Fokko Op m

Re: [DISCUSS] Apache Iceberg 1.7.2 release

2025-01-16 Thread Fokko Driesprong
pass on GH issues and I will > >> run the release (I will ping you on Slack). > >> > >> Regards > >> JB > >> > >> On Tue, Jan 14, 2025 at 9:07 AM Fokko Driesprong > wrote: > >> > > >> > Good morning everyone, > >&g

Re: [Discuss][Vote] Spec Change - Add optional field added-rows to Snapshot for Row Lineage

2025-01-17 Thread Fokko Driesprong
+0, as I agree with Amogh, I think it would fit nicely with Honah's work of formalizing the properties. Kind regards, Fokko Op vr 17 jan 2025 om 08:55 schreef Honah J. : > +1 > > Best, > Honah > > On Thu, Jan 16, 2025 at 22:54 Manish Malhotra < > manish.malhotra.w...@gmail.com> wrote: > >> +1,

Re: [VOTE] Document Snapshot Summary Optional Fields as Appendix in Spec

2025-01-15 Thread Fokko Driesprong
+1 Op wo 15 jan 2025 om 16:21 schreef Eduard Tudenhöfner < etudenhoef...@apache.org>: > +1 > > On Wed, Jan 15, 2025 at 1:20 AM rdb...@gmail.com wrote: > >> The content looks correct to me, but because this states a requirement >> ("Metrics must be accurate if written") I would rather move this c

Re: [DISCUSS] Remove snapshot-id from IRC SetStatisticsUpdate

2025-01-15 Thread Fokko Driesprong
;> >> [1] https://github.com/apache/iceberg-python/pull/1285 >> >> On Mon, Dec 16, 2024 at 5:30 AM Fokko Driesprong >> wrote: >> >>> Hey Christian, >>> >>> Great catch, I would also be in favor of removing the outer one. I don't >&g

Re: [VOTE] Simplify multi-arg table metadata

2025-02-13 Thread Fokko Driesprong
ote: >> >>> +1 (non-binding). >>> >>> Thanks, >>> Steve Zhang >>> >>> >>> >>> On Feb 9, 2025, at 1:01 AM, Fokko Driesprong wrote: >>> >>> (Second attempt, the cat <https://ibb.co/Wv4M2TDY> ran over the >>

Re: [VOTE] Add Geometry and Geography types for V3

2025-02-08 Thread Fokko Driesprong
+1 Op za 8 feb 2025 om 08:08 schreef Péter Váry : > +1 > > On Fri, Feb 7, 2025, 21:20 Kevin Liu wrote: > >> +1 (non-binding) >> It's great to see support for more data types in both parquet and >> Iceberg! >> >> Best, >> Kevin Liu >> >> On Fri, Feb 7, 2025 at 12:11 PM huaxin gao >> wrote: >> >>

Re: [VOTE] Simplify multi-arg table metadata

2025-02-09 Thread Fokko Driesprong
(Second attempt, the cat ran over the keyboard) Hey everyone, After the positive responses on the devlist , I would like to raise a vote to simplify the multi-argument transforms metadata and make it exclu

Re: [VOTE] Add overwriteRequested to RegisterTableRequest in REST spec

2025-02-13 Thread Fokko Driesprong
+1 Op do 13 feb 2025 om 18:06 schreef Steven Wu : > +1 here. > > already approved the PR yesterday > > On Thu, Feb 13, 2025 at 8:17 AM Russell Spitzer > wrote: > >> +1 >> >> On Wed, Feb 12, 2025 at 5:30 PM Steve Zhang >> wrote: >> >>> Hi Iceberg Community, >>> >>> I'm working on supporting th

Re: [VOTE] Release Apache Iceberg 1.8.0 RC0

2025-02-12 Thread Fokko Driesprong
+1 (binding) Checked signatures/tests/licenses and plugged 1.8.0 into the CI of PyIceberg . Thanks for running this Amogh! Kind regards, Fokko Op wo 12 feb 2025 om 16:57 schreef Amogh Jahagirdar <2am...@gmail.com>: > +1 (binding) > > - all si

Remove deprecated table properties

2025-02-17 Thread Fokko Driesprong
Hi everyone, While reviewing the LocationProvider equivalent of PyIceberg, I noticed some old code in the Java codebase that I felt could be cleaned up. You can find the PR over here . This one removes the deprecated properties: OBJECT_STORE_PATH = "w

Re: [DISCUSS] Consolidate docs under Concepts and Project/Terms

2025-02-17 Thread Fokko Driesprong
I've left some comments on the PR, thanks for cleaning this up Manu. Manish, regarding your question. First, I think this is a separate discussion, but a valid one. This was also suggested in the past , but got closed because I was changing diapers. I t

Re: pre-proposal: schema_id on DataFile

2025-02-14 Thread Fokko Driesprong
Hi Devin, The schema-id is stored in the Manifest Avro header: https://iceberg.apache.org/spec/#manifests Also the schema itself is stored there. Would that help your situation? I think this makes adding it to the data file redundant. Kind regards, Fokko Op vr 14 feb 2025 om 17:56 schreef Devin

[DISCUSS] Java implementation notes

2025-02-21 Thread Fokko Driesprong
Hi everyone, Recently, there was confusion about valid values for the current-snapshot-id, which resulted in implementation notes in the spec. Thanks for the reviews so far and to Dani

Re: [VOTE] Allow Row-Lineage with Equality Deletes

2025-02-20 Thread Fokko Driesprong
+1 Thanks Russell! Op do 20 feb 2025 om 10:25 schreef Péter Váry : > +1 > > Manu Zhang ezt írta (időpont: 2025. febr. 20., > Cs, 8:06): > >> +1 (non-binding) >> >> Regards >> Manu >> >> On Thu, Feb 20, 2025 at 2:57 PM Jean-Baptiste Onofré >> wrote: >> >>> +1 >>> >>> Regards >>> JB >>> >>> On W

Re: [DISCUSS] PyIceberg 0.9.0 release

2025-02-20 Thread Fokko Driesprong
t. > > Would love to hear what others think about this approach. Please let us > know if there are any concerns. > > Best, > Kevin Liu > > On Tue, Feb 18, 2025 at 7:11 AM Fokko Driesprong wrote: > >> Hey Kevin, >> >> Thanks for raising this. That sounds l

[VOTE] Java implementation notes around current-snapshot-id

2025-02-24 Thread Fokko Driesprong
Hi everyone, Recently, there was confusion about valid values for the current-snapshot-id, which led to implementation notes in the spec. Thanks for the reviews so far and to Daniel fo

Re: [VOTE] Release Apache Iceberg 1.7.2 rc0

2025-02-20 Thread Fokko Driesprong
Sorry for the delay on 1.7.2 here. After talking with JB, I had the pleasure of fixing the licenses . PTAL :) Kind regards, Fokko Op do 20 feb 2025 om 10:06 schreef Hussein Awala : > > Do you still nee

Re: [VOTE] Release Apache PyIceberg 0.9.0rc2

2025-02-25 Thread Fokko Driesprong
+1 (binding) - Ran signatures/checksum/licenses checks - Ran tests locally (3.10) - Did some local testing Thanks for running this release Drew! Kind regards, Fokko Op di 25 feb 2025 om 07:20 schreef Kevin Liu : > +1 (non-binding) > > Downloaded from SVN > * gpg: Good signature from "

Re: [ANNOUNCE] Apache Iceberg release 1.8.0

2025-02-17 Thread Fokko Driesprong
-1 cannot "go away". > > I'd prefer to keep the previous behavior - otherwise implementations may > fall back to 0, which is definitely wrong. Would be better IMHO not to > break existing implementations / render existing setups incompatible with > Iceberg 1.8. > &g

Re: [ANNOUNCE] Apache Iceberg release 1.8.0

2025-02-17 Thread Fokko Driesprong
Hey Robert, Thanks for raising this. snapshot-ID -1 isn't per-se invalid, because the valid values are not > defined in the spec. For me, this is invalid, since there is no snapshot with -1 in the snapshots property. In the tests with the PR, you can see that there are no snapshots

Re: [Discuss] Print un-pretty metadata JSON files without whitespace

2025-02-17 Thread Fokko Driesprong
Hey Ian, Thanks for raising this. The numbers you mention, do you know if this was compressed or uncompressed? I have read other issues in github which mention gigabyte-scale metadata > files. This sounds like a bad practice, and that table probably needs some maintenance. I don't have the his

Re: [DISCUSS] Consolidate docs under Concepts and Project/Terms

2025-02-19 Thread Fokko Driesprong
>> vendor-centric to me. Perhaps we should re-evaluate the contents and make >> sure it aligns with the Community Guidelines >> <https://iceberg.apache.org/community/#community-guidelines>. >> >> In general, the main site is where folks new and old to the proje

Re: [ANNOUNCE] Apache Iceberg release 1.8.0

2025-02-19 Thread Fokko Driesprong
t new implementations must not write the field if there's >>>>>> no current snapshot >>>>>> Proposal for the spec (for schema/spec/sort): >>>>>> >>>>>> * Define the valid value ranges for the fields >>>

Re: [ANNOUNCE] Apache Iceberg release 1.8.0

2025-02-18 Thread Fokko Driesprong
nal "current-snapshot-id" and if we get a >> critical mass we can try to make that change? >> Because of how wide that change would be, I think we would need pretty >> broad consensus to do so. >> >> We could possibly also have a flag to allow the old behavior

Re: Remove deprecated table properties

2025-02-18 Thread Fokko Driesprong
;>>> >>>> Just want to highlight the worst case for tables with old configuration >>>> and not aware of this deprecation might experience silent behavior change. >>>> But considering this has been deprecated for past 3 years, here’s my +1. >>>> >

Re: [DISCUSS] PyIceberg 0.9.0 release

2025-02-18 Thread Fokko Driesprong
Hey Kevin, Thanks for raising this. That sounds like a great idea to me, and thanks Drew for being the release manager for 0.9.0. Kind regards, Fokko Op ma 17 feb 2025 om 23:41 schreef Kevin Liu : > Thanks for volunteering! I'm happy to assist in any way I can. Let's > coordinate on Slack :) >

Re: Remove deprecated table properties

2025-02-19 Thread Fokko Driesprong
real gentle deprecation process for table properties, I guess > the full steps can be > >- 1.9 - warning logs with explicit msg that table loading shall fail >in a future release (like 1.10) >- 1.10 - fail the table loading >- 2.0 - remove all references to deprec

Re: [DISCUSS] Add metadata stats/metrics management on the REST Spec

2025-02-19 Thread Fokko Driesprong
Hey JB, Thanks for the additional context. My main question is, why wouldn't the TMS directly query the metadata? Since the TMS should have access to the data (otherwise it cannot compact it). This would be much faster and more efficient. I share Daniel's concern that these requests could easily r

Re: [VOTE] Release Apache PyIceberg 0.9.0rc3

2025-03-02 Thread Fokko Driesprong
Thanks Drew for running this release! +1 (binding) Checked checksums, signatures, and licenses and ran some tests locally. Kind regards, Fokko Op wo 26 feb 2025 om 22:21 schreef Kevin Liu : > +1 (non-binding) > > Following the "Verifying a release" doc >

Re: [VOTE] Deprecate or remove distinct_count

2025-03-03 Thread Fokko Driesprong
gt;>>> 12183). >>>> >>>> Jacob Marble >>>> 🔥🐅 >>>> >>>> >>>> On Tue, Feb 11, 2025 at 10:25 PM Xuanwo wrote: >>>> >>>>> Here is my +1 binding. >>>>> >>>>> The c

Re: [VOTE] Java implementation notes around current-snapshot-id

2025-03-05 Thread Fokko Driesprong
> +1 (non-binding) > > On Tue, Feb 25, 2025 at 12:49 PM Huang-Hsiang Cheng > wrote: > >> +1 (non binding) >> >> > On Feb 25, 2025, at 8:27 AM, Jean-Baptiste Onofré >> wrote: >> > >> > +1 (non binding) >> > >>

Re: [ANNOUNCE] Apache Iceberg Pre-Summit Community Meetup in SF

2025-03-10 Thread Fokko Driesprong
Nice, thanks for organizing this Sung, and thanks to Bloomberg for sponsoring. I've just signed up! Kind regards, Fokko Op ma 10 mrt 2025 om 16:22 schreef Jean-Baptiste Onofré : > Hi Sung Yun, > > That's awesome ! Thanks for that ! > > I will be there :) > > Thanks again, > Regards > JB > > On M

Re: [VOTE] Release Apache Iceberg 1.7.2 RC2

2025-03-12 Thread Fokko Driesprong
+1 (binding) I've updated the PR , but then forgot about it. Kind regards, Fokko Op wo 12 mrt 2025 om 11:35 schreef Eduard Tudenhöfner < etudenhoef...@apache.org>: > +1 (binding) > > verified sigs/checksums/tests > > On Wed, Mar 12, 2025 at 7

<    1   2   3