[Polaris Community Sync] Oct. 31, 2024 record

2024-10-31 Thread Jean-Baptiste Onofré
Hi folks, Thanks everyone for joining the Polaris Community Sync and sorry for the mess in the invite. It should be OK for the next one :) Here's the record for yesterday meeting: https://drive.google.com/file/d/1yZkcs8iif2QOFqWhr6rWOKyGJAoIR8aX/view?usp=sharing I will update the website as well

[DISCUSS] Persistence: conditional SQL UPDATE

2024-10-31 Thread Dmitri Bourlatchkov
Hi All, As discussed in the sync call today, I'm opening this email thread with the aim to clarify our approach to Persistence. So this is specific to storing data in RDBMS (leaving NoSQL to another thread). IIRC, it was mentioned in the sync call that statements like "UPDATE ... WHERE key = X a

Re: Iceberg Catalog Federation

2024-10-31 Thread Michael Collado
IMO, anything that's not directly managed by Polaris source code is external. If someone can create a table directly in the other catalog and it shows up in Polaris, it's external. As of now, all of the direct manipulation APIs are blocked for external catalogs - createTable, updateTable, etc. I t

Re: Polaris Community Meeting

2024-10-31 Thread Omar Al-Safi
Thanks Robert and JB. However, something weird, I have joined the Google group (https://groups.google.com/u/2/g/polaris-community-sync) and the invite used to show up on my calendar and is no longer there, any ideas? Thanks, Omar On Thu, Oct 31, 2024 at 5:20 PM Robert Stupp wrote: > PR's alread

Re: Iceberg Catalog Federation

2024-10-31 Thread Robert Stupp
Haven't read the proposal yet (so bear with me ;) ) Integrating other Iceberg catalogs is a great idea! However, should we maybe concentrate only on linking to external REST based catalogs and let the remote ones deal with "specialties" like how often to list namespaces/tables/views and whethe

Iceberg Catalog Federation

2024-10-31 Thread Russell Spitzer
Hi Y’all, Some of us at Snowflake and Revolut have been talking a bit about how Apache Polaris can be used in conjunction with older implementations of Apache Iceberg Catalogs. At Revolut, they have already built a version of this which allows them to use Polaris Capabilities on top of an old Cata

Re: Polaris Community Meeting

2024-10-31 Thread Robert Stupp
PR's already up ;) https://github.com/apache/polaris/pull/416 On 31.10.24 15:10, Jean-Baptiste Onofré wrote: Hi everyone, In order to be able to record the Polaris Community Meeting, I created a new invite: https://calendar.app.google/Gxg7o5CxZoD8Dh5G9 Anyone can join, and the meeting will b

Polaris Community Meeting

2024-10-31 Thread Jean-Baptiste Onofré
Hi everyone, In order to be able to record the Polaris Community Meeting, I created a new invite: https://calendar.app.google/Gxg7o5CxZoD8Dh5G9 Anyone can join, and the meeting will be automatically recorded. I will share on the dev mailing list just after. I'm updating the link on the website