Re: [Discuss] Print un-pretty metadata JSON files without whitespace

2025-03-21 Thread Marc Cenac
> Perhaps this is a good default on the catalog side when creating new metadata json. +1 for this b/c I think it's an easy performance win for tables with large metadata. Is there any reason not to have write.metadata.compression-codec default to gzip? I'm curious if there was a reason it's curr

Re: [VOTE] Deprecate IRC snapshot-id Field of SetStatisticsUpdate

2025-01-21 Thread Marc Cenac
+1 non-binding On Tue, Jan 21, 2025 at 8:19 AM Sung Yun wrote: > +1 non-binding > > Thanks for driving this Christian! > > On 2025/01/21 12:39:26 Russell Spitzer wrote: > > +1 > > > > On Tue, Jan 21, 2025 at 4:34 AM Alex Dutra > > > wrote: > > > > > +1 (nb) > > > > > > On Tue, Jan 21, 2025 at 1

Re: 1.7.1 breaking change related to ADLS support

2024-12-19 Thread Marc Cenac
:59 PM Marc Cenac wrote: > Apologies for introducing the breaking change. I just opened > https://github.com/apache/iceberg/pull/11812 to revert. Let me know if > there is something else I can do to help fix > > On Tue, Dec 17, 2024 at 8:35 AM Jean-Baptiste Onofré > wr

Re: 1.7.1 breaking change related to ADLS support

2024-12-18 Thread Marc Cenac
Apologies for introducing the breaking change. I just opened https://github.com/apache/iceberg/pull/11812 to revert. Let me know if there is something else I can do to help fix On Tue, Dec 17, 2024 at 8:35 AM Jean-Baptiste Onofré wrote: > Hi Cheng, > > Thanks for the update. The issue appeared

Re: [DISCUSS] Remove snapshot-id from IRC SetStatisticsUpdate

2024-12-17 Thread Marc Cenac
+1 to removing this redundancy in the REST spec and Java implementation On Tue, Dec 17, 2024 at 12:10 PM Kevin Liu wrote: > Hey Christian, > > Thanks for bringing this up! We also noticed this issue while implementing > table statistics in Python [1]. > I'm in favor of removing the outer field.

Re: [Proposal] Replicating version-hint onto the file system

2024-11-13 Thread Marc Cenac
Thanks for the proposal Ashvin! I see value in adding this to support the use case of allowing read only access from Snowflake. Currently we push updates with an ALTER TABLE command to synchronize our internally-hosted

Re: [Discuss] Replace Hadoop Catalog Examples with JDBC Catalog in Documentation

2024-10-17 Thread Marc Cenac
Hey Kevin, This approach sounds good to me and thanks for your work to improve the getting started docs! I would consider using the file-based sqlite rather than in-memory since I've seen some users surprised when they realize their tables disappear from the catalog upon restart, but either way i

Re: [Discuss] Replace Hadoop Catalog Examples with JDBC Catalog in Documentation

2024-10-09 Thread Marc Cenac
I support the idea of updating the docs to replace the Hadoop catalog example, but I'm wondering why not use a REST Catalog example instead? I saw Ajantha proposed adding Docker images for a REST Catalog adapter [1] so we could potentially use this with a JDBC Catalog backed by SQLite file as a co