Re: [Rust] [DataFusion] Discuss new API for remote data sources

2021-08-22 Thread Andrew Lamb
There is now a design doc [1] available for comment [1] https://docs.google.com/document/d/1ZEZqvdohrot0ewtTNeaBtqczOIJ1Q0OnX9PqMMxpOF8/edit# On Thu, Aug 19, 2021 at 2:34 PM Andrew Lamb wrote: > I wanted to draw attention to a PR[1] in the DataFusion repository that > proposes a API designed

[Rust] [DataFusion] Discuss new API for remote data sources

2021-08-19 Thread Andrew Lamb
I wanted to draw attention to a PR[1] in the DataFusion repository that proposes a API designed to abstract away access to remote datasources, to allow plugging in sources such as S3. It has had some great discussion and community engagement so far but given it is a fairly significant change to