Re: EntityCache race conditions and JCStress in Polaris

Yes, jcstress is GPL2+CE. However, jcstress would not be distributed in any way and definitely not be included in "production code". It's a test-only dependency, which should be fine. On 26.03.25 14:08, Pierre Laporte wrote: Hello all In https://github.com/apache/polaris/issues/761, there is

EntityCache race conditions and JCStress in Polaris

Hello all In https://github.com/apache/polaris/issues/761, there is a discussion on whether the EntityCache is thread-safe, prone to race conditions, inconsistencies, etc... To determine whether these issues are real, I worked on JCStress [1] tests. JCStress is a testing framework developed by O

Re: Clarification on Unique Entity Identifier in Polaris

I believe that entity ID by itself is meant to be a unique identifier. On Wed, Mar 26, 2025 at 12:27 PM Honah J. wrote: > Hi folks, > > I have a question about what constitutes a unique identifier for an entity > in Polaris in the future. > > Right now, `lookupEntity` takes catalogId, entityId,

Re: [ANNOUNCE] Welcome Dmitri Bourlatchkov, Dennis Huo and Yufei Gu to the Apache Polaris PPMC

Wow! Awesome news. Congrats folks! Mike On Wed, Mar 26, 2025 at 2:47 PM Russell Spitzer wrote: > Hi y'all! > > I'm excited to let the Polaris Community know that the PPMC has added three > new members. Dmitri Bourlatchkov, Dennis Huo and Yufei Gu are all now > members of the Polaris PPMC. > >

Re: Clarification on Unique Entity Identifier in Polaris

Correct, the entityId must be unique across all types. On Wed, Mar 26, 2025 at 12:30 PM Eric Maynard wrote: > I believe that entity ID by itself is meant to be a unique identifier. > > On Wed, Mar 26, 2025 at 12:27 PM Honah J. wrote: > > > Hi folks, > > > > I have a question about what constitu

Re: [VOTE] REST API changes for Catalog Federation - addition of ConnnectionConfigInto to ExternalCatalog

Thanks everyone for voting and providing input! The vote has now been open for about two days, and since all stakeholders who have been active on this topic have already cast votes and no new comments have been raised in the associated discussion thread on the mailing list or in the PR since last

Re: [ANNOUNCE] Welcome Dmitri Bourlatchkov, Dennis Huo and Yufei Gu to the Apache Polaris PPMC

Congratulations guys. Well deserved. On Thu, Mar 27, 2025 at 6:47 AM Prashant Singh wrote: > Congratulations folks, well deserved ! > > Best, > Prashant Singh > > On Wed, Mar 26, 2025 at 5:02 PM yun zou > wrote: > > > Congratulations! > > > > Best Regards, > > Yun > > > > On Wed, Mar 26, 2025 a

Re: Polaris benchmarks proposal

I think having a tool like this is a great idea. Would we be able to host the results over time as well? Like an official build run that triggers on a daily basis? On Wed, Mar 19, 2025 at 10:07 AM Pierre Laporte wrote: > Hi > > I have been working on a set of benchmarks for Polaris [1] and would

RE: [ANNOUNCE] Welcome Dmitri Bourlatchkov, Dennis Huo and Yufei Gu to the Apache Polaris PPMC

congrats! — Kyle Bader STSM, Principal Portfolio Architect Ceph @ IBM “two is one and one is none” - a byzantine general From: yun zou Sent: Wednesday, March 26, 2025 5:02:39 PM To: dev@polaris.apache.org Subject: [EXTERNAL] Re: [ANNOUNCE] Welcome Dmitri Bourlat

Clarification on Unique Entity Identifier in Polaris

Hi folks, I have a question about what constitutes a unique identifier for an entity in Polaris in the future. Right now, `lookupEntity` takes catalogId, entityId, and typeCode, following a recent refactoring (in a PR ). On the other hand, `lookupEntit

Re: [ANNOUNCE] Welcome Dmitri Bourlatchkov, Dennis Huo and Yufei Gu to the Apache Polaris PPMC

Congratulations folks, well deserved ! Best, Prashant Singh On Wed, Mar 26, 2025 at 5:02 PM yun zou wrote: > Congratulations! > > Best Regards, > Yun > > On Wed, Mar 26, 2025 at 4:28 PM Michael Collado > wrote: > > > Wow! Awesome news. Congrats folks! > > > > Mike > > > > On Wed, Mar 26, 2025

Re: Clarification on Unique Entity Identifier in Polaris

I'm OK with passing more through the interface. It's helpful in some use cases. That said, we should clearly distinguish which parameters are required and which are optional. Also, it's important to keep things consistent across methods, such as between lookupEntity and lookupEntities. >From what

[ANNOUNCE] Welcome Dmitri Bourlatchkov, Dennis Huo and Yufei Gu to the Apache Polaris PPMC

Hi y'all! I'm excited to let the Polaris Community know that the PPMC has added three new members. Dmitri Bourlatchkov, Dennis Huo and Yufei Gu are all now members of the Polaris PPMC. Please join me in welcoming them, Russ

Re: Clarification on Unique Entity Identifier in Polaris

This is more of an interface design question... I tend to think passing more information down into the persistence layer is a good thing. So if providing catalog ID, entity type, maybe even subtype, etc. can help the persistence layer, we shouldn't be afraid to pass it down. One other thing worth

Re: Clarification on Unique Entity Identifier in Polaris

Thanks for the clarification! Just to confirm — even though the entityId is globally unique, we’ll still require catalogId + entityId at the persistence API level to perform an entity lookup now and in the future, correct? On Wed, Mar 26, 2025 at 1:45 PM Dennis Huo wrote: > Correct, the entityId

Re: [ANNOUNCE] Welcome Dmitri Bourlatchkov, Dennis Huo and Yufei Gu to the Apache Polaris PPMC

Congratulations all, well deserved. It's nice to see the community expanding. Regards, Keith. http://keith-chapman.com On Wed, Mar 26, 2025 at 7:40 PM Ajantha Bhat wrote: > Congratulations guys. Well deserved. > > On Thu, Mar 27, 2025 at 6:47 AM Prashant Singh > wrote: > > > Congratulations

Re: [DISCUSS] Initial location for Spark Client

Hi I’m fine to start with the plugin as part of main repo. We can always move later if needed. I guess we also include the plugin in Polaris releases (same version). I will check the dep and distributed artifacts to verify there is no “legal” issue. Regards JB Le mar. 25 mars 2025 à 21:20, yun

Re: Clarification on Unique Entity Identifier in Polaris

Hi Afair entityId is unique. Regards JB Le mer. 26 mars 2025 à 20:27, Honah J. a écrit : > Hi folks, > > I have a question about what constitutes a unique identifier for an entity > in Polaris in the future. > > Right now, `lookupEntity` takes catalogId, entityId, and typeCode, > following a r

Re: EntityCache race conditions and JCStress in Polaris

Hi If the dependency is used for test (and not bundled in one of our distributed artifacts) and we don’t copy code from this dependency, we can use GPL/LGPL dependency. What matters is the code we copy from another project and the dependencies we bundle in our artifacts. Regards JB Le mer. 26 ma

Re: [ANNOUNCE] Welcome Dmitri Bourlatchkov, Dennis Huo and Yufei Gu to the Apache Polaris PPMC

Congrats all! The podling is in good hands. On Wed, Mar 26, 2025 at 9:23 PM Keith Chapman wrote: > Congratulations all, well deserved. It's nice to see the community > expanding. > > Regards, > Keith. > > http://keith-chapman.com > > > On Wed, Mar 26, 2025 at 7:40 PM Ajantha Bhat > wrote: > > >