Re: [VOTE] Add 'inherited' and 'namespaces' Fields to GetApplicablePolicies API Response

2025-04-09 Thread Jean-Baptiste Onofré
+1

It looks good to me, thanks !

Regards
JB

On Fri, Apr 4, 2025 at 2:21 PM Honah J.  wrote:
>
> Hi folks,
>
> I'd like to raise a vote for adding `inhertied` and `namespaces` fields to
> GetApplicablePolicies' response. These fields give users more information
> about whether the effective policy is inherited from its parent and the
> namespaces where the effective policy is located. You can find more details
> in the discussion thread:
>
> https://lists.apache.org/thread/z2lh1cqjcznc1qvtwy46bq18p6psz5bn
>
> This vote will be open for at least 72 hours.
>
> [ ] +1 Merge https://github.com/apache/polaris/pull/1277
> [ ] +0
> [ ] -1 Do not merge because...


[DISCUSS] Add Polaris Observe API

2025-04-09 Thread Jean-Baptiste Onofré
Hi folks,

I would like to discuss a proposal that I have in mind: the "observe" API.

The purpose of this API is to return some metrics and gauges from Polaris, like:
- what's number of entities (number of tables, views; etc) in a Polaris catalog
- what's the number of times a entity as been accessed on a period
- optionaly, access to "polished" metrics from table (extracted++ from
the metadata)
- optionaly, provide extra details (from Parquet metrics for instance)

In terms of use cases, this API could be helpful:
- to have a policy "activated" depending of this metrics (something
like policy A is only valid if a catalog has more than X tables, or
policy B is activated when a view has been accessed more than Y times
in the last hour, etc). We can have TMS service "fined triggered" with
these policies.
- to be leverage by a FGAC mechanism (e.g. governance depending of
these metrics)
- to be easily displayed by a UI or CLI

I already have a few ideas in mind that I would be happy to share in a
design document. But before that, I would like to get your feedback
about this proposal.

Thanks !
Regards
JB


Re: [DISCUSS] Preparing 0.10.0 release including binary distributions

2025-04-09 Thread Jean-Baptiste Onofré
Hi

Quick update about the release prep:
1. LICENSE/NOTICE are now included in the distributions (I will do a
pass just before the release to check the versions)
2. I opened another PR to include "clean" LICENSE/NOTICE in our
distributed artifacts (on Maven):
https://github.com/apache/polaris/pull/1292

NB: these PRs are "one shoot" effort before the first release
including distributed binary artifacts.

When the second PR will be merged, I will move forward and prepare the
release from main.

Regards
JB

On Thu, Mar 27, 2025 at 11:41 PM Jean-Baptiste Onofré  wrote:
>
> Hi everyone
>
> I opened the PR to fix LICENSE/NOTICE in our polaris server and admin
> distributions:
>
> https://github.com/apache/polaris/pull/1258
>
> I'm now verifying LICENSE/NOTICE in our distributed artifacts (on
> Maven). I will open a PR today.
>
> When these two PRs will be merged, I will move forward on the release.
>
> Thanks,
> Regards
> JB
>
> On Fri, Mar 14, 2025 at 10:58 AM Jean-Baptiste Onofré  
> wrote:
> >
> > Hi folks,
> >
> > We are working on the 1.0.0 release, with a lot of new features and fixes.
> >
> > One important change between 0.9.0 and 1.0.0 is the publication of the
> > binary distributions, with all related requirements (LICENSE/NOTICE,
> > etc).
> > I'm working on the LICENSE/NOTICE and binary distributions publication.
> > Considering the time we needed to complete the 0.9.0 release, I think
> > it would be great to "anticipate" a little before 1.0.0. It would
> > allow us to "accelerate" on the 1.0.0 release and beyond.
> >
> > I would like to propose the 0.10.0 release, as an "intermediate"
> > release. I would like to prepare this release by the end of next week,
> > creating the 0.10.x branch (based on the main branch) on Saturday,
> > March 22 and cutting the 0.10.0 release on Monday, March 24.
> >
> > Thoughts ?
> >
> > Regards
> > JB


Re: [VOTE] Add 'inherited' and 'namespaces' Fields to GetApplicablePolicies API Response

2025-04-09 Thread Dennis Huo
+1, thanks!

On Mon, Apr 7, 2025 at 3:12 PM Yufei Gu  wrote:

> +1. Thanks Jonas for the change!
> Yufei
>
>
> On Sat, Apr 5, 2025 at 6:45 PM Honah J.  wrote:
>
> > Hi folks,
> >
> > Thanks for the feedback and discussion so far. Based on our PR discussion
> > about naming, we’ve simplified “namespace-path” to “namespace” for
> clarity.
> >
> > Please continue to vote.
> >
> > Thanks,
> > Honah (Jonas)
> >
> > On Fri, Apr 4, 2025 at 8:22 PM Dmitri Bourlatchkov 
> > wrote:
> >
> > > Thanks for the update Honah!
> > >
> > > Upgrading my vote to +1
> > >
> > > Cheers,
> > > Dmitri.
> > >
> > > On Fri, Apr 4, 2025 at 7:54 PM Honah J.  wrote:
> > >
> > > > Thank you for your comment. Based on our discussion, I renamed the
> new
> > > > "namespaces" field to "namespace-path". This change better reflects
> > that
> > > > the field identifies a single namespace and differentiates it from
> the
> > > > namespace parameter, which is a single string.
> > > >
> > > > Please continue to vote.
> > > >
> > > > Thanks,
> > > > Honah(Jonas)
> > > >
> > > > On Fri, Apr 4, 2025 at 4:42 PM Dmitri Bourlatchkov  >
> > > > wrote:
> > > >
> > > > > +0 the PR looks ok to me, but I made a non-critical comment in GH.
> > > > >
> > > > > Thanks,
> > > > > Dmitri.
> > > > >
> > > > > On Fri, Apr 4, 2025 at 5:23 PM Honah J.  wrote:
> > > > >
> > > > > > Hi folks,
> > > > > >
> > > > > > I'd like to raise a vote for adding `inhertied` and `namespaces`
> > > fields
> > > > > to
> > > > > > GetApplicablePolicies' response. These fields give users more
> > > > information
> > > > > > about whether the effective policy is inherited from its parent
> and
> > > the
> > > > > > namespaces where the effective policy is located. You can find
> more
> > > > > details
> > > > > > in the discussion thread:
> > > > > >
> > > > > > https://lists.apache.org/thread/z2lh1cqjcznc1qvtwy46bq18p6psz5bn
> > > > > >
> > > > > > This vote will be open for at least 72 hours.
> > > > > >
> > > > > > [ ] +1 Merge https://github.com/apache/polaris/pull/1277
> > > > > > [ ] +0
> > > > > > [ ] -1 Do not merge because...
> > > > > >
> > > > >
> > > >
> > >
> >
>


Re: [VOTE] Add 'inherited' and 'namespaces' Fields to GetApplicablePolicies API Response

2025-04-09 Thread Honah J.
Thanks everyone for discussing and voting!

The vote is passed with
Results:
+1: 3 (binding), 0 (non-binding)
+0: 0 (binding), 0 (non-binding)
-1: 0 (binding), 0 (non-binding)

Best regards,
Honah (Jonas)

On Wed, Apr 9, 2025 at 1:59 PM Dennis Huo  wrote:

> +1, thanks!
>
> On Mon, Apr 7, 2025 at 3:12 PM Yufei Gu  wrote:
>
> > +1. Thanks Jonas for the change!
> > Yufei
> >
> >
> > On Sat, Apr 5, 2025 at 6:45 PM Honah J.  wrote:
> >
> > > Hi folks,
> > >
> > > Thanks for the feedback and discussion so far. Based on our PR
> discussion
> > > about naming, we’ve simplified “namespace-path” to “namespace” for
> > clarity.
> > >
> > > Please continue to vote.
> > >
> > > Thanks,
> > > Honah (Jonas)
> > >
> > > On Fri, Apr 4, 2025 at 8:22 PM Dmitri Bourlatchkov 
> > > wrote:
> > >
> > > > Thanks for the update Honah!
> > > >
> > > > Upgrading my vote to +1
> > > >
> > > > Cheers,
> > > > Dmitri.
> > > >
> > > > On Fri, Apr 4, 2025 at 7:54 PM Honah J.  wrote:
> > > >
> > > > > Thank you for your comment. Based on our discussion, I renamed the
> > new
> > > > > "namespaces" field to "namespace-path". This change better reflects
> > > that
> > > > > the field identifies a single namespace and differentiates it from
> > the
> > > > > namespace parameter, which is a single string.
> > > > >
> > > > > Please continue to vote.
> > > > >
> > > > > Thanks,
> > > > > Honah(Jonas)
> > > > >
> > > > > On Fri, Apr 4, 2025 at 4:42 PM Dmitri Bourlatchkov <
> di...@apache.org
> > >
> > > > > wrote:
> > > > >
> > > > > > +0 the PR looks ok to me, but I made a non-critical comment in
> GH.
> > > > > >
> > > > > > Thanks,
> > > > > > Dmitri.
> > > > > >
> > > > > > On Fri, Apr 4, 2025 at 5:23 PM Honah J. 
> wrote:
> > > > > >
> > > > > > > Hi folks,
> > > > > > >
> > > > > > > I'd like to raise a vote for adding `inhertied` and
> `namespaces`
> > > > fields
> > > > > > to
> > > > > > > GetApplicablePolicies' response. These fields give users more
> > > > > information
> > > > > > > about whether the effective policy is inherited from its parent
> > and
> > > > the
> > > > > > > namespaces where the effective policy is located. You can find
> > more
> > > > > > details
> > > > > > > in the discussion thread:
> > > > > > >
> > > > > > >
> https://lists.apache.org/thread/z2lh1cqjcznc1qvtwy46bq18p6psz5bn
> > > > > > >
> > > > > > > This vote will be open for at least 72 hours.
> > > > > > >
> > > > > > > [ ] +1 Merge https://github.com/apache/polaris/pull/1277
> > > > > > > [ ] +0
> > > > > > > [ ] -1 Do not merge because...
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>