Hello Iceberg community, As you may already know, Project Comet <https://github.com/apache/arrow-datafusion-comet>, a plugin to accelerate Spark query execution via leveraging DataFusion and Arrow, has been open sourced under the Apache Arrow umbrella. To capitalize on the capabilities of Project Comet, I propose the implementation of a dynamic plugin mechanism. This mechanism will enable seamless integration with not only Project Comet but also other native execution engines.
I have prepared a spec <https://docs.google.com/document/d/1WTagYUQsykfBiAHYDwi_ogUxbHROJdStTp9EZ63POhk/edit> and also submitted a corresponding PR <https://github.com/apache/iceberg/pull/9721/>. Your feedback on this proposal would be greatly appreciated. Thanks, Huaxin
