Glad to see Polaris to join Apache incubator, together with Iceberg and other ecosystems.
As a mentor of Gravitino project, I think the two projects have different visions and can work together: Gravitino is an open data catalog for various data sources including data lake formats, and Polaris is an Iceberg REST catalog (at least today) with enterprise-level security control over different cloud storages. They server different purposes and can work together. Good luck to Polaris! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC member, Apache Incubator PMC member, Email: shaofeng...@apache.org Nicholas Jiang <nicholasji...@apache.org> 于2024年8月1日周四 11:41写道： > Hi JB, > > > > > Thanks for driving the proposal of Polaris. I have some questions about > the PolarisProposal as follows: > > > > > 1. Is Polaris positioning oriented towards a unified catalog of data lakes > and computing engines, which has mentioned as "Polaris is a catalog for > data lakes" and "Polaris is connected with Apache Iceberg, Apache Hadoop, > Apache Spark, Apache Flink, and potentially Apache Hudi, Apache XTable, …"? > > > > > 2. If Polaris is only a catalog for data lakes, why not directly provide a > catalog wrapper and implementaion of Gravitino catalog in Gravitino project? > > > > > Regards, > > Nicholas Jiang > > > At 2024-07-31 01:33:57, "Jean-Baptiste Onofré" <j...@nanthrax.net> wrote: > >Hi folks, > > > >We would like to propose a new project to the ASF incubator: Polaris. > > > >Polaris is a catalog for data lakes. It provides new levels of choice, > >flexibility and control over data, with full enterprise security and > >Apache Iceberg interoperability across a multitude of engines and > >infrastructure. Polaris builds on standards such as those created by > >Apache Iceberg, providing the following benefits for the ecosystem: > >* Multi-engine interoperability over a single copy of data, > >eliminating the need for moving and copying data across different > >engines and catalogs. > >* An interoperable security model providing a unified authorization > >layer independent from the engines processing analytical tables. > >* For multi-catalog scenarios, a unified catalog level view of data > >across multiple catalogs via catalog notification integrations. > >* The ability to host Polaris Catalog on the infrastructure of your > choice. > > > >Here is the proposal: > >https://cwiki.apache.org/confluence/display/INCUBATOR/PolarisProposal > > > >Comments and feedback are welcome. > > > >Thanks! > >Regards > >JB > > > >--------------------------------------------------------------------- > >To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > >For additional commands, e-mail: general-h...@incubator.apache.org >
