Hello Rust / Arrow community, There is a proposal [1] in DataFusion to switch the abstraction used to read from remote object storage. Due to various reasons, this code is currently in its own crate/library [2] with unclear governance. We would like to contribute this code to the Apache Arrow project and I am hoping to gather community feedback on this idea.
The full details can be found on [3]. Here is the rationale 1. A common, high quality object store abstraction for communicating with various remote object stores is useful for a range of projects and usecases. 2. Such a library is directly aligned with the Arrow mission of providing building blocks for modern high performance analytics systems 3. The clear governance of Apache Arrow offers the best chance to build a unified and strong community around this crate, hopefully both increasing its adoption and attracting community contributions for its long term evolution and maintenance Please let us know your thoughts, Andrew [1] https://github.com/apache/arrow-datafusion/issues/2489 [2] https://github.com/influxdata/object_store_rs/issues/41 [3] https://github.com/influxdata/object_store_rs/issues/41
