Re: Hive 4 support

Hi Wing Yew, Thanks for taking a look at this. After the removal of the Hive runtime code, we only depend on HMS in the HiveCatalog module in the production code. Since HMS API is supposed to be backward compatible, I would prefer to keep a single hive-metastore module and a single source dir for

Re: [VOTE] Row lineage required for v3

+1 On Mon, Mar 31, 2025 at 12:01 PM Anton Okolnychyi wrote: > +1 (binding) > > - Anton > > пн, 31 бер. 2025 р. о 11:43 Daniel Weeks пише: > >> Hey Everyone, >> >> I'd like to raise the proposal to make row-lineage required >> by default to a vote.

[DISCUSS] Inconsistent NoSuchNamespaceException handling in REST Catalog API specification

Hello! Apache Iceberg REST Catalog API specification has many handlers that contain namespace name in the request path or request body. Some of such handlers regarding this specification can return NoSuchNamespaceException (with 404 http code) https://github.com/apache/iceberg/blob/1.8.x/open-api/r

Re: [VOTE] Row lineage required for v3

Thanks to everyone for taking the time to discuss and vote! I'm going to call the vote as passing with: 9 +1 binding votes 6 +1 non-binding votes (no 0/-1 votes cast) -Dan On Tue, Apr 1, 2025 at 12:22 PM Fokko Driesprong wrote: > +1 > > Op di 1 apr 2025 om 21:15 schreef Péter Váry > >> +1 >>

Fwd: Apache Iceberg IRAP Status [SEC=OFFICIAL]

Forwarded from pr...@pache.org. Please respond to the original sender, if you choose to reply. BKP -- Forwarded message - From: Parisa Nafis via press Date: Tue, Mar 18, 2025 at 6:15 AM Subject: Apache Iceberg IRAP Status [SEC=OFFICIAL] To: secur...@apache.org Cc: pr...@apache.o

Re: [DISCUSS] FileFormat API proposal

Hi everyone, I have updated the File Format API PR ( https://github.com/apache/iceberg/pull/12298) based on the answers and review comments. I would like to merge this only after the 1.9.0 release so we have more time finding any issues and solving them before this goes to a release for the users

Re: [VOTE] Row lineage required for v3

+1 (binding) Thanks Dan! On Mon, Mar 31, 2025 at 1:20 PM Ryan Blue wrote: > +1 > > On Mon, Mar 31, 2025 at 12:01 PM Anton Okolnychyi > wrote: > >> +1 (binding) >> >> - Anton >> >> пн, 31 бер. 2025 р. о 11:43 Daniel Weeks пише: >> >>> Hey Everyone, >>> >>> I'd like to raise the proposal to mak

Re: Optimize Equality Deletes with Sorting

Hi Edgar, Thanks for the well described proposal! Knowing the Flink connector, I have the following concerns: - Flink connector currently doesn't sort the rows in the data files. It "chickens" out of this to avoid keeping anything in memory. - Sorting the equality delete rows would also add memor

Re: [DISCUSS] FileFormat API proposal

Hi Renije, *> 1. **File format filters* *>* > Do the filters include both filter expressions from both user query and delete filter? The current discussion is about the filters from the user query. About the delete filter: Based on the suggestions on the PR, I have moved the delete filter out fr

Re: [VOTE] Improve OpenAPI documentation around how NamespaceNotEmptyException is treated

I have updated the spec to use 409 in order to indicate the NamespaceNotEmptyException On Mon, Mar 17, 2025 at 7:12 PM Christian Thiel wrote: > +1 (non-binding) for the updated 409 Code > > On Fri, 14 Mar 2025 at 18:30, Ryan Blue wrote: > >> From the issue, it looks like we're using 400 for thi

Re: [VOTE] Minor simplifications for Geo Spec

+1 (non-binding) On Wed, Mar 19, 2025, 2:02 PM Yufei Gu wrote: > +1 > Yufei > > > On Wed, Mar 19, 2025 at 10:42 AM Fokko Driesprong > wrote: > >> +1 >> >> Kind regards, >> Fokko >> >> Op wo 19 mrt 2025 om 18:32 schreef Huang-Hsiang Cheng >> : >> >>> +1 (non-binding) >>> >>> On Mar 19, 2025, at

Re: [DISCUSS] Multi-arg transforms

Hi Fokko Sorry for the late reply :) 1. It sounds good to me. 2. I started to work on the core to use only source-ids. The Writer is writing only source-ids, whereas the Reader detects if source-id exists and use it (for backward compatibility). By using source-ids, it's clearly simpler and consi

Re: [Discuss] Apache Iceberg 1.9.0 release

Hi I guess we have to check the impact of https://nvd.nist.gov/vuln/detail/CVE-2025-30065 and update if needed. I will check there. Regards JB Le lun. 17 mars 2025 à 11:59, Ajantha Bhat a écrit : > Hey everyone, > > Following the plan from the 1.8.0 release, I'll be handling the 1.9.0 > relea

Re: [DISCUSS] Row lineage required for v3

During the sync, we were mostly aligned that the row lineage semantics for updates depends on how the writer engine interprets/implements (e.g. Flink with equality deletes). Now, if we make it required for V3 tables, what if users don't need the row lineage feature. There is a bit overhead (althou