Hi Justin,
Thanks, it's clearer to me now. I updated the proposal according to
your comments:
- using only "Initial Committers" instead of the split between PPMC
members and committers
- slim down from 18 to 8 names
I give more time to this discussion today, I will move forward to a
vote (as prop
> On Aug 1, 2024, at 7:23 PM, Justin Mclean wrote:
>
> Hi,
>
> My issue is not that this is a single-vendor project or that people have been
> recognised for non-code contributions - both are fine. I would suggest that
> the project slims down the initial committer list and not split it int
Hi,
My issue is not that this is a single-vendor project or that people have been
recognised for non-code contributions - both are fine. I would suggest that the
project slims down the initial committer list and not split it into PPMC and
committers. As part of the incubating process, you can v
5 mentors are awesome! Excited to see this kind of support.
Cheers,
Wangda
On 2024/08/01 13:21:09 Jean-Baptiste Onofré wrote:
> Hi Wangda,
>
> Thanks for your message and your proposal. Now, we already have 5
> mentors on the proposal. For good execution/mentoring, I think it's
> largely enoug
Hi Dave,
Thanks for your message.
I'm a bit confused now: it seems that we have a consensus that the
Polaris proposal is solid and correct (according to the number of
positive feedback in this discussion so far).
Justin expressed concerns, asking to update the proposal. As said, I
understand the
Hi Justin,
> In short, this seems to me (and I could be wrong) like a project mostly from
> a single vendor, but the proposal has been made to make it look like more
> people are involved. It may well be that these people will be involved, but
> I’d prefer if the project was upfront about this
> On Jul 31, 2024, at 6:56 PM, Justin Mclean wrote:
>
> Hi,
>
>> I understand your comment, and it's important to me.
>> If it's a concern for you, I'm happy to rework the initial committer
>> list with the team (also removing PPMC list to use the default layout)
>> and grow the PPMC/committe
This is an exciting proposal and I'm really happy to see it, would love to see
it incubate and eventually graduate!
- Jef
On 2024/07/30 17:33:57 Jean-Baptiste Onofré wrote:
> Hi folks,
>
> We would like to propose a new project to the ASF incubator: Polaris.
>
> Polaris is a catalog for data l
Hi Nicholas,
I think Gravitino and Polaris are complementary by addressing
different use cases.
Gravitino is focusing on metadata lake with metadata features
(metadata management, metadata governance, geo-distribution, AI asset
management).
Polaris is focusing on Apache Iceberg REST Catalog impl
Hi Wangda,
Thanks for your message and your proposal. Now, we already have 5
mentors on the proposal. For good execution/mentoring, I think it's
largely enough. I will let know you if one mentor wants to be
replaced.
Thanks again!
Regards
JB
On Thu, Aug 1, 2024 at 2:43 AM Wangda Tan wrote:
>
>
Glad to see Polaris to join Apache incubator, together with Iceberg and
other ecosystems.
As a mentor of Gravitino project, I think the two projects have different
visions and can work together: Gravitino is an open data catalog for
various data sources including data lake formats, and Polaris is
Hi JB,
Thanks for driving the proposal of Polaris. I have some questions about the
PolarisProposal as follows:
1. Is Polaris positioning oriented towards a unified catalog of data lakes and
computing engines, which has mentioned as "Polaris is a catalog for data lakes"
and "Polaris is co
Hi,
I notice a number of people offering to be mentors. Experience has shown that
three or four mentors seem to be best. More than that, and you can end up with
a situation where everyone thinks everyone else is doing the job, so no one
does it. If a mentor is not active during incubation they
Hi,
> I understand your comment, and it's important to me.
> If it's a concern for you, I'm happy to rework the initial committer
> list with the team (also removing PPMC list to use the default layout)
> and grow the PPMC/committers when in the incubator.
I think that would be in the best intere
It is a super interesting project, I'm +1 on Polaris joining the Apache
incubator. I'd be willing to offer guidance or be a mentor if needed.
Best,
Wangda Tan
On 2024/07/30 17:33:57 Jean-Baptiste Onofré wrote:
> Hi folks,
>
> We would like to propose a new project to the ASF incubator: Polaris.
Thanks, JB! I can add myself.
On Wed, Jul 31, 2024 at 1:55 PM Jean-Baptiste Onofré
wrote:
> Thanks for your input Ryan ! Much appreciated.
>
> We would love to have you as mentor ! Do you want me to update the proposal
> wiki page or you do ?
>
> Thanks again
>
> Regards
> JB
>
> Le mer. 31 juil
Thanks for your input Ryan ! Much appreciated.
We would love to have you as mentor ! Do you want me to update the proposal
wiki page or you do ?
Thanks again
Regards
JB
Le mer. 31 juil. 2024 à 22:28, Ryan Blue a
écrit :
> I'm glad to see this proposal because people have been talking about
>
I'm glad to see this proposal because people have been talking about
working on an implementation of the Iceberg REST catalog spec for a long
time. I don't think that it is a good idea to put an implementation in the
Iceberg project itself, so it is great to see a project that intends to
build one
> On Jul 31, 2024, at 4:02 PM, Tyler Akidau wrote:
>
> From project overlap perspective, I just want to echo Jack’s take on things:
> Polaris for now is fully focused on Iceberg, taking a depth first approach,
> with the goal of implementing the entire Iceberg REST API spec and helping
> push
Hey folks,
I wanted to give a little bit of additional context beyond what JB and Jack
have said so far in other threads. Everyone’s observations about the level of
community code contributions, the committer/PPMC list setup, adjacency to other
projects, etc. are spot on. The code has been pret
Hi David,
I guess Justin meant "a lot of the proposed PPMC members".
Regards
JB
On Wed, Jul 31, 2024 at 6:11 PM David Jencks wrote:
>
> "a lot of the proposed PMCs”
>
> There are a lot of projects mentioned in this thread, and I think this is
> genuinely ambiguous. Do you mean PMCs or PMC memb
"a lot of the proposed PMCs”
There are a lot of projects mentioned in this thread, and I think this is
genuinely ambiguous. Do you mean PMCs or PMC members?
David Jencks
> On Jul 30, 2024, at 8:47 PM, Justin Mclean wrote:
>
> Hi,
>
> In general, projects joining the incubator need two things
Hi François,
To my knowledge, there's no minimum number of initial committers.
Some projects have a very small initial committers list (I remember
OpenDAL proposal with 4 initial committers), some have longer list
(Beam proposal contained 18 initial committers + interested
contributors).
I think
Hi,
I don't see the problem with people that contribute to a project without
writing source code, as I know we already have these kind of people in
ASF projects.
Just for my information, do we have some numbers about the min
contributors on a project and initial committers to be accepted in
Just to provide some additional data points to JB's point about
contributions that are not code, me (and other PPMC members) have been
involved in the Polaris community for quite some time now, and we have been
brainstorming ideas and driving important designs to lay a good foundation
for the proje
Hi
Project Nessie (https://projectnessie.org/) is a catalog for data
lakes, also implementing the Apache Iceberg REST spec.
Nessie has some unique features like git-inspired data version
control, multi-table transaction, catalog level versioning, etc.
In order to build a larger community and provi
Just curious. What's the relationship between Nessie and Polaris?
Jean-Baptiste Onofré 于2024年7月31日周三 20:09写道：
> Hi Justin,
>
> Thanks for your email. Much appreciated!
>
> I agree with the requirements to join the incubator, I share the same
> vision.
>
> The codebase is there, public, under th
Hi Justin,
Thanks for your email. Much appreciated!
I agree with the requirements to join the incubator, I share the same vision.
The codebase is there, public, under the Apache license. So, I think
we are good here :)
About the community, it's a small one, but present, vibrant, and eager
to gr
I added myself to the proposal.
Thank you JB,
Kent
On 2024/07/31 10:27:41 Jean-Baptiste Onofré wrote:
> Hi Kent
>
> Happy to add you as mentor! Do you want to update the proposal wiki or I do
> ?
>
> Thanks !
>
> Regards
> JB
>
> Le mer. 31 juil. 2024 à 09:31, Kent Yao a écrit :
>
> > +1 o
Hi Kent
Happy to add you as mentor! Do you want to update the proposal wiki or I do
?
Thanks !
Regards
JB
Le mer. 31 juil. 2024 à 09:31, Kent Yao a écrit :
> +1 on Poraris entering to Apache. I'm interested in helping as a mentor if
> needed.
>
> Kent Yao
>
> On 2024/07/31 07:02:05 ConradJam
Hi,
In general, projects joining the incubator need two things:
- A codebase
- a community around it
While this isn't a hard requirement, building either while in incubation can be
difficult.
The first issue I see is it’s not clear to me that there is a community here.
The split between PPMC
Hi,
I sent a reply earlier, but my email is acting up and looks like it didn’t get
through. I have some concerns with this proposal.
In general, the incubator likes projects to have a code base and a small
community, I’m not seeing a community here. Trying to build one during
incubation can be
+1 on Poraris entering to Apache. I'm interested in helping as a mentor if
needed.
Kent Yao
On 2024/07/31 07:02:05 ConradJam wrote:
> As members of the Amoro project, our team is thrilled to see the growing
> attention towards Amoro.
>
> We are excited about Polaris becoming open source, as it
As members of the Amoro project, our team is thrilled to see the growing
attention towards Amoro.
We are excited about Polaris becoming open source, as it opens up greater
possibilities for future collaboration with the Amoro community.
Amoro focuses on data lake formats and aims to provide optim
> What's the difference between this project and Amoro
Here is my $0.01, please correct me if I am wrong, especially for people
working on Amoro and Gravitino.
I think Apache Amoro is focused more on being a self-contained complete
data lakehouse management and ingestion system. It is a complete
Hi Manu
Thanks for the details !
I agree with you. As mentor on Gravitino, I would be more than happy
to connect the two podlings.
Regards
JB
On Wed, Jul 31, 2024 at 7:00 AM Manu Zhang wrote:
>
> AFAIK, Amoro is a management system with optimization service, catalog
> service, etc. It has a bui
AFAIK, Amoro is a management system with optimization service, catalog
service, etc. It has a built-in catalog but can also work with other
catalogs like Polaris.
I think Polaris is more comparable to Gravitino which entered the incubator
recently. It would be interesting to see how these two commu
Hi Dave
Most of the listed PPMC members are not ASF member, but they could be
interested to mentors.
So, even if some of them don't have code-contributions on Polaris,
they are helping a lot in the roadmap, use cases, design, etc. They
would like to help in terms of governance and community buildi
Hi
The proposal is more generic: today it's Apache Iceberg, but after the
discussions with the initial community we agreed it could make sense
to address other use cases.
I don't know Amoro in details, but I am happy to bridge the
communities to work together.
Regards
JB
On Wed, Jul 31, 2024 at
Hi, JB
Thank you for starting this thread; it's great to see an increasing number of
projects being developed around Iceberg.
I have two questions:
- The polaris github repo said it's "an open source catalog for Apache
Iceberg", but the proposal changed into "a catalog for data lakes". Does it
> On Jul 30, 2024, at 11:34 AM, Jean-Baptiste Onofré wrote:
>
> Hi Dave,
>
> That's a good question. The main reason is because we wanted people
> with Apache experience in the PPMC to mentor the committers and
> contributors heading to PPMC as well.
> Also, the initial committers worked clos
Hi Alex,
Correct me if I'm wrong (even if I know Wayang :)), Wayang is more on
the data processing (with features like zero-copy, etc).
Polaris is a catalog, basically providing the metadata for a
table/view name and dealing with access to table/view.
So Wayang could work with Polaris to retrieve
Hi,
Good question too :)
The project codebase went public, and we squashed a bunch of commits
and changed the history, and we lost some commits.
That said, you are right: if everyone contributed on the ideas,
visions, draft etc, not everyone on the lists (both PPMC members and
committers) contribu
Hey JB,
What’s the difference to Wayang?
—a.
Sent from my mobile, please excuse typos
> On Jul 30, 2024, at 8:40 PM, Ayush Saxena wrote:
>
> Hi JB,
> Apart from the questions from Dave, I have an additional question
> about the initial committers & PPMC members, Did those folks
> contribut
Hi JB,
Apart from the questions from Dave, I have an additional question
about the initial committers & PPMC members, Did those folks
contribute anything to the project so far? I checked the repository
[1], most of them here have some trivial 1-2 contributions. & then the
initial PR [2], it does me
Hi Dave,
That's a good question. The main reason is because we wanted people
with Apache experience in the PPMC to mentor the committers and
contributors heading to PPMC as well.
Also, the initial committers worked closely with PPMC guidance
(explaining the ICLA, good practice, etc).
So, we wanted
Hi JB,
An interesting project that looks pretty mature.
I’m curious about the split between Initial PPMC and initial Committer. In the
usual case a new podling will have all of the Initial Committers on the PPMC.
Can you tell us why this is not the case with Polaris?
Best,
Dave
> On Jul 30, 2
Hi folks,
We would like to propose a new project to the ASF incubator: Polaris.
Polaris is a catalog for data lakes. It provides new levels of choice,
flexibility and control over data, with full enterprise security and
Apache Iceberg interoperability across a multitude of engines and
infrastruct
48 matches
Mail list logo
