[Discuss] Add Policy Privileges and PolicyGrant to Management Spec

2025-05-13 Thread Honah J.
Hi folks, I would like to propose extending the management API specification to add policy-related privileges and making Policy a valid securable for "addGrantToCatalogRole" and "revokeGrantFromCatalogRole". This could allow users to manage policy-related privileges via management APIs. Here is t

Re: [PROPOSAL] Asynchronous & Reliable Tasks

2025-05-13 Thread Adnan Hemani
Hi Robert, Firstly, thanks for this document. One quick question: is the `behavior ID` basically the task type? This part was slightly unclear to me. Best, Adnan Hemani > On May 9, 2025, at 6:07 AM, Robert Stupp wrote: > > Hi, > > Polaris is a service, which has to eventually perform operati

Proposal for Implementation of the Proposed Iceberg REST Spec - Events API

2025-05-13 Thread Adnan Hemani
Hi all, I am raising a proposal to implement the proposed Iceberg REST specification for the Events API (doc , GH ). It is my understanding th

Re: Discussion: Re-evaluating Realm Modeling in Polaris

2025-05-13 Thread Dmitri Bourlatchkov
Thanks for the summary, Prashant! I believe 1 DataSource (database) per realm _is_ possible with current code, but it also implies one JVM per realm (just to clarify the last paragraph in your message). Given that the need for strong realm isolation at the database level is likely to co-exist wit

Re: [ANNOUNCE] Relational JDBC the new default for persistence

2025-05-13 Thread Dmitri Bourlatchkov
Thanks for implementing the new JDBC persistence, Prashant! It's great to see that JDBC persistence is more stable under concurrent load now. Would you be able to share any detailed performance test numbers for the new JDBC Persistence implementation? I believe the doc linked in your message com

Re: Discussion: Re-evaluating Realm Modeling in Polaris

2025-05-13 Thread Yufei Gu
It was unfortunate Quarkus doesn't provide the capability to configure multiple data sources without recompilation. It left us no choice but to use a custom data source manager. It doesn't seem urgent to me though. I'm fine with the current strategy until there are strong use cases demanding a sepa

Re: Discussion: Re-evaluating Realm Modeling in Polaris

2025-05-13 Thread Prashant Singh
Hey folks, Apologies for the delay, I wanted to bring up one issue which we faced during the implementation of 1 JVM supporting multiple realms essentially 1 DS per realm which to be injected via quarkus props i.e https://github.com/apache/polaris/pull/1482 and using quarkus managed DS and seek p

[ANNOUNCE] Relational JDBC the new default for persistence

2025-05-13 Thread Prashant Singh
Dear Polaris Community, Over the few weeks, Polaris Persistence under-went major refactor to get rid of the transactional dependencies and completely adopt CAS semantics (Compare and Swap), simplifying the schema. As a result I am pleased to announce the new JDBC implementation which is considera