Hi, huaxin: Thanks for raising this discussion. It seems that the doc is read only and we can't comment on it.
I'll take a look at Project Comet and try to see how to integrate it with iceberg-rust, since they are both written in rust. On Wed, Feb 14, 2024 at 12:15 PM Holden Karau <holden.ka...@gmail.com> wrote: > This is great work! Very excited to see this. > > Cell : 425-233-8271 > > > On Tue, Feb 13, 2024 at 4:38 PM huaxin gao <huaxin.ga...@gmail.com> wrote: > >> Hello Iceberg community, >> >> As you may already know, Project Comet >> <https://github.com/apache/arrow-datafusion-comet>, a plugin to >> accelerate Spark query execution via leveraging DataFusion and Arrow, has >> been open sourced under the Apache Arrow umbrella. To capitalize on the >> capabilities of Project Comet, I propose the implementation of a dynamic >> plugin mechanism. This mechanism will enable seamless integration with not >> only Project Comet but also other native execution engines. >> >> I have prepared a spec >> <https://docs.google.com/document/d/1WTagYUQsykfBiAHYDwi_ogUxbHROJdStTp9EZ63POhk/edit> >> and also submitted a corresponding PR >> <https://github.com/apache/iceberg/pull/9721/>. Your feedback on this >> proposal would be greatly appreciated. >> >> Thanks, >> Huaxin >> >> >> >>