[Discuss] Proposal to Adjust Catalog Sync Schedule & Cancel Next Wednesday’s Meeting

Hi everyone, Thank you all for your participation in the catalog community sync so far! I'm writing to discuss changes to the meeting schedule to better fit everyone's availability and make our discussions more productive. Here’s a quick summary of the current cadence

Re: [DISCUSS] Hive Support

> > It is my understanding that removing the hive-metastore module is NOT > under consideration; is that correct? > Correct, the modules under discussion here are specifically iceberg-mr and iceberg-hive3. I don't see any problems for other modules to upgrade to Hive 3. On Thu, Nov 21, 2024 at 4:

Re: [Discuss] Proposal to Adjust Catalog Sync Schedule & Cancel Next Wednesday’s Meeting

Thanks for arranging this! +1 on Keep the Wednesday 9 AM Pacific Time meeting every 3 weeks Yufei On Wed, Nov 20, 2024 at 3:48 PM Honah J. wrote: > Hi everyone, > > Thank you all for your participation in the catalog community sync so far! > I'm writing to discuss changes to the meeting sched

Re: [VOTE] Deprecate and remove last-column-id

+1 (non-binding) On Wednesday, November 20, 2024, Daniel Weeks wrote: > +1 > > On Wed, Nov 20, 2024, 9:41 AM Aihua Xu wrote: > >> +1 non-binding. >> >> Thanks for driving this. >> >> On Tue, Nov 19, 2024 at 5:50 PM Renjie Liu >> wrote: >> >>> +1, thanks Fokko! >>> >>> On Wed, Nov 20, 2024 at 8

Re: [DISCUSS] Hive Support

Also to clarify -- It is my understanding that removing the hive-metastore module is NOT under consideration; is that correct? We still need a Hive version to depend on for the hive-metastore module. In https://github.com/apache/iceberg/pull/10996, this is Hive 3. Does this present any problem? O

Re: [VOTE] Deprecate and remove last-column-id

+1 On Wed, Nov 20, 2024, 9:41 AM Aihua Xu wrote: > +1 non-binding. > > Thanks for driving this. > > On Tue, Nov 19, 2024 at 5:50 PM Renjie Liu > wrote: > >> +1, thanks Fokko! >> >> On Wed, Nov 20, 2024 at 8:45 AM Steve Zhang >> wrote: >> >>> +1 nb >>> >>> Thanks, >>> Steve Zhang >>> >>> >>> >>

Re: [VOTE] Deprecate and remove last-column-id

+1 non-binding. Thanks for driving this. On Tue, Nov 19, 2024 at 5:50 PM Renjie Liu wrote: > +1, thanks Fokko! > > On Wed, Nov 20, 2024 at 8:45 AM Steve Zhang > wrote: > >> +1 nb >> >> Thanks, >> Steve Zhang >> >> >> >> On Nov 19, 2024, at 12:18 AM, Fokko Driesprong wrote: >> >> Hi everyone,

Re: [DISCUSS] Hive Support

To clarify, the changes discussed here don't affect hive connectors in engines, which either use the built-in hive version (Spark) or can be upgraded to hive 3 (Flink). On Wed, Nov 20, 2024 at 2:19 PM Manu Zhang wrote: > Okay, let me add this option > > D. Drop Hive 2 & 3 support and suggest to

Re: [VOTE] Deprecate and remove last-column-id

Thanks Fokko. To be clear, are you proposing to deprecate last-column-id in 1.8.0 and remove in 1.9.0+? On Tue, Nov 19, 2024 at 4:18 PM Fokko Driesprong wrote: > Hi everyone, > > Based on the positive feedback on the [DISCUSS] thread >

Re: [DISCUSS] - Deprecate Equality Deletes

Good points Micah, A few additional points: - Russell mentioned partial updates as a possible feature - I would like to see that it is possible to read the current content of the table (with all of the committed changes) without an engine - no complicated joins / high amount of data in memory / et

Re: [VOTE] Deprecate and remove last-column-id

+1 -Jack On Tue, Nov 19, 2024 at 7:45 AM Russell Spitzer wrote: > +1 > > On Tue, Nov 19, 2024 at 4:11 AM Fokko Driesprong wrote: > >> Hey Manu, >> >> That's an excellent question. I took the following rationale: >> >>- For the code, the iceberg-core module, a minor release deprecation >>

Re: [DISCUSS] Iceberg 1.7.1 release

Hi Bryan, This bug fix has been merged. Thanks for taking this in. Fix changelog table bug for start time older than current snapshot: https://github.com/apache/iceberg/pull/11564. Yufei On Fri, Nov 15, 2024 at 9:17 AM Aihua Xu wrote: > That makes sense. Originally I thought wasb scheme chan

Re: [DISCUSS] REST: Way to query if metadata pointer is the latest

Hi Gabor, On HTTP Caching: If an HTTP client library performs caching by default and doesn’t allow disabling it, I believe that library shouldn’t be used - at least in the context of this discussion. The kind of HTTP client library I have in mind is one that handles encoding and decoding of HT

Re: Iceberg python library sync

Hi everyone, FYI, the next community python library sync meeting will be on Tuesday (11/26/2024) at 9 AM (US/Pacific). Here is the meeting agenda for the topics to discuss: https://docs.google.com/document/d/1oMKodaZJrOJjPfc8PDVAoTdl02eGQKHlhwuggiw7s9U/edit?tab=t.0#bookmark=kix.9murh4sgx5h2. Pleas