Hi Henri,

The idea to provide a simple, open standard interface to enable integration of 
3rd party compute engines and tools is great, however, there are concerns about 
the suggested design.

-1 on the current implementation (+1 more Jetty server on HMS instance)

org.apache.iceberg.rest.HMSCatalogServer
Server httpServer = new Server(port)

* Iceberg provides a pluggable catalog interface on the client side to manage 
table metadata for creating, altering, and dropping tables, allowing seamless 
integration with existing data systems. 

* We should not embed or tight RestCatalog to the HMS. It should be an 
independent component with a pluggable design (work with different data 
catalogs, such as Hive, Snowflake, Glue, etc.)

* Breaking down complex systems into independently deployable services improves 
scalability, flexibility, and maintenance simplicity.

Regards,
Denys




Reply via email to