Re: [DISCUSS] Proposal to expand Arrow Communications

2024-02-02 Thread David Li
I like this new direction, and I think it'll be actually viable unlike the Flight-UCX work that was attempted a couple years ago. I think the hardcoded endpoints in Flight RPC are difficult for other projects (including Flight SQL!) to build on top of, and we would serve users better by - stand

[DISCUSS] Proposal to expand Arrow Communications

2024-02-02 Thread Matt Topol
Hey all, In my current work I've been experimenting and playing around with utilizing Arrow and non-cpu memory data. While the creation of the ArrowDeviceArray struct and the enhancements to the Arrow library Device abstractions were necessary, there is also a need to extend the communications spe

Re: [DISCUSS] Conventions for transporting Arrow data over HTTP

2024-02-02 Thread Alessandro Molina
On Wed, Dec 6, 2023 at 7:45 PM Ian Cook wrote: > > I am interested to hear more perspectives on this. My perspective is > that we should recommend using HTTP conventions to keep clean > separation between the Arrow-formatted binary data payloads and the > various application-specific fields. This

Re: [VOTE][RUST][DataFusion] Release DataFusion Python Bindings 35.0.0 RC1

2024-02-02 Thread Andrew Lamb
+1 (binding) Verified on M3 mac As before it seems as if python 3.11 isn't supported in the verification script, only python 3.10. When I used 3.10 everything looks good. Thanks a lot, Andrew On Thu, Feb 1, 2024 at 7:27 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M1 Mac. > > Thanks A