>
> Thanks for the reference. I feel like this must've been shared earlier but
> I missed it.
If it seems familiar, it was mentioned in this earlier user ML thread [1].
The other thing I'd be curious about is if we can generalize this subset of
> SQL/Substrait to drivers for other 'storage layer
Thanks for the reference. I feel like this must've been shared earlier but I
missed it.
Another direction I mean to explore: implementing an Arrow Dataset backend
using ADBC, so that we can feed SQL databases (and now Delta Lake) into
(Py)Arrow Dataset, and then further into Acero (and the R pa
>
> You could do something like what Matt Topol's done for Go
>
Thank you for the link! That's very similar to what I am thinking for Rust.
I will look at that as a reference. :)
What do you plan for a "query" to mean to the ADBC Delta Lake driver? Would
> that be a subset of Substrait that gets
Exciting!
You could do something like what Matt Topol's done for Go: define a native Go
API for ADBC, then a generic adapter to wrap any Go ADBC driver as a C one. See
[1]. As a bonus, you can then have a more natural (and safe) API for
implementing the actual driver, and relegate the fiddly F
Andrew and David,
I'm starting to work on the ADBC connector for Delta Lake (in the delta-rs
repo) [1], written in Rust.
I'm thinking there's some general code I can factor out to make it easier
for Rust developers to create ADBC drivers. I've created an issue to track
that in the arrow-rs repo [
With 4 +1 votes (3 binding) the release is approved
The release is available here:
https://dist.apache.org/repos/dist/release/arrow/arrow-rs-31.0.0
It has also been released to crates.io
Thank you to everyone who helped verify this release
Raphael
On 13/01/2023 21:26, L. C. Hsieh wrote:
+1
