Re: [DISCUSS] Rest Catalog 419 Response Code

Thank you for your response, Dan! I agree with all your points. On the other hand, I guess readers of the Catalog REST API spec may still be uncertain about when specific error codes MAY or SHOULD occur (using the traditional RFC language). Do you think it might be worth clarifying the REST spec

Re: [DISCUSS][Rust] Frequency of upgrading minimum supported rust version.

Personally I prefer a longer gap(like three months) so that we don't need to force users to upgrade to the rust version. But this may not be a big problem in the rust world as rust's release is usually quite stable and backward compatible. On Fri, Feb 21, 2025 at 11:30 AM Renjie Liu wrote: > Hi:

Re: [DISCUSS][Rust] Frequency of upgrading minimum supported rust version.

Hi, renjie Thank you for bringing this up. Most of our users are currently using the latest stable or even nightly Rust, so MSRV itself is not a major concern at the moment. We can upgrade to Rust 1.85 (the first version to support Edition 2024!) today. However, if we do need to establish an M

[DISCUSS][Rust] Frequency of upgrading minimum supported rust version.

Hi: As discussed in this issue , we have landed support for using unstable rust for tooling, while stable rust for publishing libraries. Also we enforced checking of msrv(minimum supported rust version) in our ci. However, there is one thing undet

Re: [DISCUSS] Rest Catalog 419 Response Code

Hey Sung, My interpretation is that it's up to the REST Server to decide whether to send a 419 or 401 response code (I don't think it's a mandate). The use case for 419 would be that the client has client credentials or can re-authenticate via some other mechanism and could reattempt the request.

Re: [VOTE] Release Apache Iceberg 1.7.2 rc0

Sorry for the delay on 1.7.2 here. After talking with JB, I had the pleasure of fixing the licenses . PTAL :) Kind regards, Fokko Op do 20 feb 2025 om 10:06 schreef Hussein Awala : > > Do you still nee

Re: Spark: Copy Table Action

Hi Thanks to Steve Zhang, we have a doc now of how to use RewriteTablePaths as part of table replication (hot off the nightly doc build): https://iceberg.apache.org/docs/nightly/spark-procedures/#table-replication. You can use it in like: - RegisterTable , returns CopyPlan and lastVersionFileN

Re: [VOTE] Allow Row-Lineage with Equality Deletes

+1 Yufei On Thu, Feb 20, 2025 at 10:12 AM rdb...@gmail.com wrote: > +1 > > On Thu, Feb 20, 2025 at 10:01 AM Aihua Xu wrote: > >> +1 (non-binding). >> >> On Thu, Feb 20, 2025 at 9:41 AM Huang-Hsiang Cheng >> wrote: >> >>> +1 (non-binding) >>> >>> Thanks, >>> Huang-Hsiang >>> >>> On Feb 20, 202

Re: [VOTE] Allow Row-Lineage with Equality Deletes

+1 Best, Honah On Thu, Feb 20, 2025 at 10:45 AM Yufei Gu wrote: > +1 > Yufei > > > On Thu, Feb 20, 2025 at 10:12 AM rdb...@gmail.com > wrote: > >> +1 >> >> On Thu, Feb 20, 2025 at 10:01 AM Aihua Xu wrote: >> >>> +1 (non-binding). >>> >>> On Thu, Feb 20, 2025 at 9:41 AM Huang-Hsiang Cheng >>>

Re: [VOTE] Allow Row-Lineage with Equality Deletes

+1 On Thu, Feb 20, 2025 at 10:01 AM Aihua Xu wrote: > +1 (non-binding). > > On Thu, Feb 20, 2025 at 9:41 AM Huang-Hsiang Cheng > wrote: > >> +1 (non-binding) >> >> Thanks, >> Huang-Hsiang >> >> On Feb 20, 2025, at 9:37 AM, huaxin gao wrote: >> >> +1 (non-binding) >> >> Thanks Russell! >> >> On

Re: [VOTE] Allow Row-Lineage with Equality Deletes

+1 (non-binding). On Thu, Feb 20, 2025 at 9:41 AM Huang-Hsiang Cheng wrote: > +1 (non-binding) > > Thanks, > Huang-Hsiang > > On Feb 20, 2025, at 9:37 AM, huaxin gao wrote: > > +1 (non-binding) > > Thanks Russell! > > On Thu, Feb 20, 2025 at 1:57 AM Fokko Driesprong wrote: > >> +1 >> >> Thanks

Re: [VOTE] Allow Row-Lineage with Equality Deletes

+1 (non-binding) Thanks, Huang-Hsiang > On Feb 20, 2025, at 9:37 AM, huaxin gao wrote: > > +1 (non-binding) > > Thanks Russell! > > On Thu, Feb 20, 2025 at 1:57 AM Fokko Driesprong > wrote: >> +1 >> >> Thanks Russell! >> >> Op do 20 feb 2025 om 10:25 schreef Péter

Re: [VOTE] Allow Row-Lineage with Equality Deletes

+1 (non-binding) Thanks Russell! On Thu, Feb 20, 2025 at 1:57 AM Fokko Driesprong wrote: > +1 > > Thanks Russell! > > Op do 20 feb 2025 om 10:25 schreef Péter Váry >: > >> +1 >> >> Manu Zhang ezt írta (időpont: 2025. febr. 20., >> Cs, 8:06): >> >>> +1 (non-binding) >>> >>> Regards >>> Manu >>

Re: [VOTE] Release Apache Iceberg 1.8.1 RC0

I'm working on the licensing fix. Regards JB On Thu, Feb 20, 2025 at 3:03 PM Eduard Tudenhöfner wrote: > > @Yuya you're absolutely right and thanks for reporting this. This was a > mistake on my part that I didn't catch. I've created > https://github.com/apache/iceberg/pull/12351 to fix this.

Re: Spark: Copy Table Action

Hi all, thank you very much for the progress so far, I believe this is very helpful to DR and other use cases that require copying the table from place to place. I can see we support rewriting table paths in the metadata files now, I wonder if you have a plan for the next step to have a more full i

Re: [VOTE] Release Apache Iceberg 1.8.1 RC0

@Yuya you're absolutely right and thanks for reporting this. This was a mistake on my part that I didn't catch. I've created https://github.com/apache/iceberg/pull/12351 to fix this. I'm cancelling this RC and will create RC1 once that PR and the licensing stuff has been fixed. On Thu, Feb 20,

Re: [DISCUSS] FileFormat API proposal

Hi Peter sorry for the late reply on this. I did a pass on the proposal, it's very interesting and well written. I like the DataFile API and definitely worth to discuss all together. Maybe we can schedule a specific meeting to discuss about DataFile API ? Thoughts ? Regards JB On Tue, Feb 11,

Re: [DISCUSS] PyIceberg 0.9.0 release

Thanks Kevin for raising this! - For the first issue, I think we should remove the deprecation message and throw an error when the table reference is used. - I don't think we should throw, I've left a comment on the PR . - F

Re: [VOTE] Release Apache Iceberg 1.8.1 RC0

Hi, Thank you for preparing RC, Eduard. I tested 1.8.1 on Trino. The S3-compatible storage issue has been resolved, but Unity catalog and tabulario/iceberg-rest:1.6.0 tests are still failing. Those catalogs don't return endpoints in /v1/config, so they fall back to DEFAULT_ENDPOINTS. Thus, RESTSe

Re: [VOTE] Release Apache Iceberg 1.8.1 RC0

+0 (non binding) I checked: - hash and checksum are good - LICENSE and NOTICE are good in the source distribution - no binary file found in the source distribution - ASF header is present in all expected file - able to build from the source distribution - I did "smoke tests" with Spark and Polaris

Re: [VOTE] Allow Row-Lineage with Equality Deletes

+1 Thanks Russell! Op do 20 feb 2025 om 10:25 schreef Péter Váry : > +1 > > Manu Zhang ezt írta (időpont: 2025. febr. 20., > Cs, 8:06): > >> +1 (non-binding) >> >> Regards >> Manu >> >> On Thu, Feb 20, 2025 at 2:57 PM Jean-Baptiste Onofré >> wrote: >> >>> +1 >>> >>> Regards >>> JB >>> >>> On W

Re: [VOTE] Allow Row-Lineage with Equality Deletes

+1 Manu Zhang ezt írta (időpont: 2025. febr. 20., Cs, 8:06): > +1 (non-binding) > > Regards > Manu > > On Thu, Feb 20, 2025 at 2:57 PM Jean-Baptiste Onofré > wrote: > >> +1 >> >> Regards >> JB >> >> On Wed, Feb 19, 2025 at 11:13 PM Russell Spitzer >> wrote: >> > >> > The PR: https://github.com

Re: [VOTE] Release Apache Iceberg 1.7.2 rc0

> Do you still need 1.7.2 or 1.8.0/1.8.1 is good enough for you ? If 1.8.1 will be released soon, that would be great. We prefer not to use the first release for a minor version in production and wait for at least a patch release, but 1.7.X is completely broken. On Thu, Feb 20, 2025 at 8:30 AM E

Re: [VOTE] Release Apache Iceberg 1.7.2 rc0

Let's go then :) I'm happy to resume the process here :) Regards JB On Thu, Feb 20, 2025 at 8:28 AM Eduard Tudenhöfner wrote: > > I think we should still do 1.7.2 and not leave it in a broken state. > > On Thu, Feb 20, 2025 at 7:56 AM Jean-Baptiste Onofré > wrote: >> >> Hi Hussein >> >> We we

[VOTE] Release Apache Iceberg 1.8.1 RC0

Hi Everyone, I propose that we release the following RC as the official Apache Iceberg 1.8.1 release. The commit ID is 673192d9152a5532f2a84aa2fc815cfa16f7f203 * This corresponds to the tag: apache-iceberg-1.8.1-rc0 * https://github.com/apache/iceberg/commits/apache-iceberg-1.8.1-rc0 * https://gi