Re: Overwrite old properties on table replace with REST catalog

ween catalogs would resemble the infamous ORM myth > "Just switch the database." So perhaps a sensible amount of flexibility in > catalog behavior seems to be a good compromise, IMO. > > WDYT? > > Regards, > Vladimir > > > > On Thu, Oct 24, 2024 at 8:41 PM Hai

[DISCUSS] Partial Metadata Loading

Hello Dev list, I want to update the community on the current thread for the proposal "Partially Loading Metadata - LoadTable V2" after hearing more perspectives from the community. In general, there are still some distance to go for a general consensus which I hope to foster more conversations an

Re: Overwrite old properties on table replace with REST catalog

Hello Vladimir, I want to raise that we've been observing similar behavior differences regarding CREATE OR REPLACE between Hive/Hadoop catalog and REST catalog at here: https://github.com/apache/iceberg/issues/11109 The context: Iceberg spark integration test has traditionally only included tests

[DISCUSS, INVITATION] Partially Load Metadata Proposal

Hello Iceberg Community, I'd like to have a follow up discussion on my proposal: Partially Loading Metadata

Re: [PROPOSAL] Partially Loading Metadata - LoadTable V2

>> That POC would need to be expanded so that it doesn't only do this for >> snapshots, but also for other fields. >> I believe the main fields that can get quite large over time are *snapshots >> / metadata-log / snapshot-log / schemas*. >> >> Might be worth

[PROPOSAL] Partially Loading Metadata - LoadTable V2

Hello Dev List, I want to bring this proposal to discussion: https://docs.google.com/document/d/1eXnT0ZiFvdm_Zvk6fLGT_UxVWO-HsiqVywqu1Uk8s7E/edit#heading=h.uad1lm906wz4 It proposes a new LoadTable API (branded LoadTableV2 at the moment) on REST spec that allows partially loading table metada

REST Catalog based Integration Test for Query Engines

Hello dev-list, *What* I'm looking for issues and PRs reviews from the community to enable REST Catalog based Integration Test for Query Engines. Issue: https://github.com/apache/iceberg/issues/11079 PR: https://github.com/apache/iceberg/pull/11093 *Background* Recently, thanks to @Daniel's effo