I'm starting a new thread for this discussion (this was previously
discussed in the Rust Roadmap thread).

The reason I got involved with Arrow is that I have been working on
DataFusion[1] which is currently an in-process SQL query engine on top of
Arrow. It allows queries to be executed against the Arrow CSV reader (and
will shortly support the Arrow Parquet reader too) and presents results as
a sequence of RecordBatch instances.

I would like to donate this code to the Arrow project so that Arrow has a
Rust-native query execution engine built in and to accelerate development
of this capability.

I have a fairly detailed roadmap[2] in mind for the project and it could
eventually become a standalone project potentially (under ASF still).

I don't know what the process is to vote on this, so wanted to discuss that
in this thread first.

References:

[1] DataFusion: https://github.com/andygrove/datafusion
[2] Roadmap: https://github.com/andygrove/datafusion/blob/master/ROADMAP.md

Thanks,

Andy.

Reply via email to