Re: [DISCUSS] Adding pathStyleAccess to AwsStorageConfigInfo

Hi Dmitri, +1, personally I don't see any harm to add, plus besides supporting S3-compatible storages, this allows supporting legacy s3 buckets that still use path style access Regards, Omar On Wed, Jul 9, 2025 at 1:52 AM Dmitri Bourlatchkov wrote: > Hi All, > > I propose to add a boolean `pat

Re: [DISCUSS] Polaris Delegation Service for Long-Running Tasks

Hi all, Overall Polaris deserves a thorough asynchronous task handling infrastructure. The general difference to my proposal [1] is that this one is a dedicated service. It seems that there will be different implementations of task types depending on whether those are run inside Polaris or inside

Re: [DISCUSS] Hive Catalog federation in Polaris

Following up on my email: Polaris would really benefit from supporting HMS and other catalog types. And the way I see to get there is to have a "HMS only" IRC service, which can be legibly built on Java 11, use Kerberos, etc. Polaris can then federate to that HMS catalog. AFAIU clients can authent

Re: [DISCUSS] Hive Catalog federation in Polaris

Let's recap what Polaris offers: 1. Multi tenancy via realms 2. Multiple catalogs per realm 3. OAuth/OIDC Adding Kerberos is global per JVM, making #1 impossible and likely also not suitable for #2, plus adding another complicated and complex auth mechanism. If Kerberos is a strong concern, I prop

[Discuss] Default commit message during merge/squash

Hi all, While adding the recommendation to working with the PR on site docs, we have opened an issue https://github.com/apache/polaris/issues/1656 to update the settings. I have discussed with ASF Infra and they mentioned, we can update by ourselves. Hence, I opened a PR for the same: https://gith

Re: [Discuss] Default commit message during merge/squash

Hi all, >From experience in the past, the initially created PR summary and description do not fully match the eventually merged change. This is why I mentioned "... contributors should review the PR summary and description before opening a PR and committers should really review both the summary an

Re: [Discuss] Default commit message during merge/squash

Hi >From technical standpoint, the commit template can be updated via asf.yaml. It’s a change we did on the parser a few months ago. Regards JB Le mer. 9 juil. 2025 à 04:30, Ajantha Bhat a écrit : > Hi all, > While adding the recommendation to working with the PR on site docs, > we have opened

Re: [PROPOSAL] Commit Deconfliction

I think there's a better way to achieve the results that this proposal is aiming for. If I understand correctly, this is trying to create a way for Polaris to be able to apply changes from one commit on top of another without sending a commit conflict back to the client. Parallel appends are the pr

Re: [Discuss] Default commit message during merge/squash

Is it possible to adjust the PR description generated by renovate to better align with what you're looking for? The docs seem to suggest that it can be done with e.g. {{{commitList}}} --EM On Wed, Jul 9, 2025 at 9:08 AM Robert Stupp

Re: [Discuss] Default commit message during merge/squash

My biggest concern is the Renovate PRs. The commit message of those is suitable for being merged "as is" - but the PR description is not. Given the amount of Renovate-PRs it's a lot of cognitive work to adjust those - or the commit log would look really really awful with a ton of not useful informa

Re: [Community Meeting] NoSQL Support in Apache Polaris

This meeting is to: 1. Walkthrough this proposal https://docs.google.com/document/d/1POUWe0xMZOBoaJ6Rgiw35ziEoc6OEYCiW7Zk6bR9H6M/edit?tab=t.0#heading=h.nx9vzhg2x8v2 2. Maybe, look at some of the high-level modules in the draft PR https://github.com/apache/polaris/pull/1189 In regards to Spanner, t

Re: [Community Meeting] NoSQL Support in Apache Polaris

The invite says July 16th? On Wed, Jul 9, 2025 at 8:02 PM Jean-Baptiste Onofré wrote: > > Hi folks, > > Several contributors asked an update about NoSQL support in Apache Polaris. > > Now that Polaris 1.0 is almost there :) I propose to have a meeting to > resume the discussion. > > I scheduled a

Re: [Community Meeting] NoSQL Support in Apache Polaris

My bad, yes, it's 7/16. Regards JB On Wed, Jul 9, 2025 at 2:04 PM Robert Stupp wrote: > > The invite says July 16th? > > On Wed, Jul 9, 2025 at 8:02 PM Jean-Baptiste Onofré wrote: > > > > Hi folks, > > > > Several contributors asked an update about NoSQL support in Apache Polaris. > > > > Now t

Re: [Community Meeting] NoSQL Support in Apache Polaris

Actually the invite was not correct: the meeting is on 7/17 as originally in my first email. Sorry for the confusion. Regards JB On Wed, Jul 9, 2025 at 2:06 PM Jean-Baptiste Onofré wrote: > > My bad, yes, it's 7/16. > > Regards > JB > > On Wed, Jul 9, 2025 at 2:04 PM Robert Stupp wrote: > > >

[ANNOUNCE] Apache Polaris 1.0.0-incubating

The Apache Polaris team is pleased to announce Apache Polaris 1.0.0-incubating. Apache Polaris is an open-source, fully-featured catalog for Apache Iceberg™. It implements Iceberg's REST API, enabling seamless multi-engine interoperability across a wide range of platforms, including Apache Doris™,

[Community Meeting] NoSQL Support in Apache Polaris

Hi folks, Several contributors asked an update about NoSQL support in Apache Polaris. Now that Polaris 1.0 is almost there :) I propose to have a meeting to resume the discussion. I scheduled a community meeting for July 17th 9am PST: https://calendar.app.google/8gBEGDxq2vqoQePz5 If you are in

Re: [Community Meeting] NoSQL Support in Apache Polaris

Re: Spanner: The NoSQL proposal can certainly be extended to Spanner. However, if the question is about Byron's Spanner Persistence implementation as discussed in the last Community sync, I believe that work is not related to the NoSQL proposal (and we do not even have a PR for it yet). Cheers, D

Re: [ANNOUNCE] Apache Polaris 1.0.0-incubating

Congratulations folks for this milestone! On Thu, 10 Jul 2025, 02:41 Yufei Gu, wrote: > The Apache Polaris team is pleased to announce Apache Polaris > 1.0.0-incubating. > > Apache Polaris is an open-source, fully-featured catalog for Apache > Iceberg™. It implements Iceberg's REST API, enabling

Re: [Community Meeting] NoSQL Support in Apache Polaris

I know that there was a spanner implementation mentioned in a recent community sync, is that also part of the same discussion? On Wed, Jul 9, 2025 at 11:12 AM Jean-Baptiste Onofré wrote: > Actually the invite was not correct: the meeting is on 7/17 as > originally in my first email. > > Sorry fo

Re: [Discuss] Default commit message during merge/squash

Hi Robert, > Having the list of commits in the merge commit message proposed by GitHub helps there. Can you elaborate on this? How exactly does it help? You can always view the commits on the original PR. Beyond that, I actually don't see these commit messages being added currently when I look a

Re: [DISCUSS] Prepare for 1.0 Release

RNs LGTM. Thanks, Yufei! Cheers, Dmitri. On Tue, Jul 8, 2025 at 8:41 PM Yufei Gu wrote: > Hi everyone, > > Please take 5 minutes to check the 1.0.0 release notes: > > https://docs.google.com/document/d/1JDVdQraoEhOIv7agy7WzIuBQdW0_16jW-DBrnanuW7A/edit?tab=t.0 > . > We will publish it right afte

Re: [ANNOUNCE] Apache Polaris 1.0.0-incubating

Congratulations to the team. Great work. Regards, Neelesh S. Salian On Wed, Jul 9, 2025 at 17:41 Yufei Gu wrote: > The Apache Polaris team is pleased to announce Apache Polaris > 1.0.0-incubating. > > Apache Polaris is an open-source, fully-featured catalog for Apache > Iceberg™. It implement

Re: [PROPOSAL] Commit Deconfliction

Hey Ryan, that's exactly the intent. If the Iceberg REST protocol itself can provide a way for clients to express which commits (or which aspects of commits) can be reconciled with which other commits then I think that would be ideal. Beyond reconciliation, I think fine-grained commits are just a g

Re: [ANNOUNCE] Apache Polaris 1.0.0-incubating

Awesome to see this. Congratulations to the Polaris community! Best, Kevin Liu On Wed, Jul 9, 2025 at 5:41 PM Yufei Gu wrote: > The Apache Polaris team is pleased to announce Apache Polaris > 1.0.0-incubating. > > Apache Polaris is an open-source, fully-featured catalog for Apache > Iceberg™. I