Re: Rust bindings for Gandiva

2019-05-11 Thread Renjie Liu
I agree that this should be a separate project, so that this can be used by other databases written in rust, not only datafusion. Let's start with an implementation by binding with gandiva, and build pure rust implementation later. On Sat, May 11, 2019 at 10:28 PM Andy Grove wrote: > Hi Renjie,

Re: Rust bindings for Gandiva

2019-05-11 Thread Andy Grove
Hi Renjie, I have not started on this but I would be interested in helping you with it. At a high level I think there are two main parts to this work: 1. Translating DataFusion expressions to Gandiva protobuf 2. Implementing the code to make the native C call to Gandiva I could help with #1 pre

Re: Rust bindings for Gandiva

2019-05-11 Thread Renjie Liu
Hi: @Andy Grove Are you developing this? I'm interested in this and want to join development. On Tue, Jan 8, 2019 at 3:18 PM Praveen Kumar wrote: > Agree with Wes, the protobuf based interface should be the language neutral > way to build expressions with Gandiva. > > On Mon, Jan 7, 2019 at 8:3

Re: Rust bindings for Gandiva

2019-01-07 Thread Praveen Kumar
Agree with Wes, the protobuf based interface should be the language neutral way to build expressions with Gandiva. On Mon, Jan 7, 2019 at 8:30 PM Andy Grove wrote: > This makes sense to me know that I understand a little more about Gandiva. > This also fits well with my proposal to donate DataFu

Re: Rust bindings for Gandiva

2019-01-07 Thread Andy Grove
This makes sense to me know that I understand a little more about Gandiva. This also fits well with my proposal to donate DataFusion in the other thread. DataFusion can manage the overall logical query plan in Rust and potentially delegate some subset of expression evaluation to Gandiva via protobu

Re: Rust bindings for Gandiva

2019-01-07 Thread Wes McKinney
Gandiva supports a Protobuf-based interface -- this is how Java interacts with it via JNI. Rust could do the same -- that would probably be easier than wrapping the C++ class structure. It would also help drive new feature requirements in the serialized projection/filter expression trees - Wes On

Re: Rust bindings for Gandiva

2019-01-07 Thread Krisztián Szűcs
I'm not sure, that a binding is a good idea. Both Arrow and Parquet already have their own rust implementation, and a interfacing with cpp isn't as easy and straightforward than it is with C. Otherwise We could simply just maintain bindings for all of the cpp libraries, rather than of having a hybr

Re: Rust bindings for Gandiva

2019-01-05 Thread Wes McKinney
t; experienced with C++/cmake. > > P > > Get Outlook for iOS<https://aka.ms/o0ukef> > > From: Andy Grove > Sent: Friday, January 4, 2019 9:39 AM > To: dev@arrow.apache.org > Subject: Rust bindings for Gandiva > > Now that the Rust i

Re: Rust bindings for Gandiva

2019-01-04 Thread paddy horan
gandiva on windows? I’m willing to help where I can but I’m not very experienced with C++/cmake. P Get Outlook for iOS<https://aka.ms/o0ukef> From: Andy Grove Sent: Friday, January 4, 2019 9:39 AM To: dev@arrow.apache.org Subject: Rust bindings for Gandiv

Rust bindings for Gandiva

2019-01-04 Thread Andy Grove
Now that the Rust implementation of Arrow is maturing, I'm interested in having bindings for Gandiva for query execution, rather than duplicating this in Rust. I will likely start looking at this soon but wanted to see if anyone else here is particularly interested in this area of functionality?

Re: Rust bindings

2018-03-28 Thread Andy Grove
; >> production-ready to go into the master branch. >> > >> >> > >> Thanks >> > >> >> > >> On Fri, Mar 23, 2018 at 11:51 AM, Andy Grove > (mailto:andygrov...@gmail.com)> >> > >> wrote: >> > >

Re: Rust bindings

2018-03-24 Thread Andy Grove
t; > >> interested > > >> > in a native Rust implementation but it should be possible to have > traits > > >> > defining the interface and two implementations - one native and one > using > > >> > FFI to call C. Rust has zero overhead when ca

Re: Rust bindings

2018-03-23 Thread Krisztián Szűcs
gt; about how complete it is. > >> >> > > >> >> > I think it is better for people to see it in the arrow repo being > >> >> actively > >> >> > developed. I'm very interested in getting compatibility unit tests > >> set up >

Re: Rust bindings

2018-03-23 Thread Wes McKinney
t; > clearance procedure harder with more individual contributors involved? >> > >> > Thanks, >> > >> > Andy. >> > >> > >> > >> > On Fri, Mar 23, 2018 at 9:11 AM, Wes McKinney >> wrote: >> > >> >>

Re: Rust bindings

2018-03-23 Thread Andy Grove
ually make the > IP > > clearance procedure harder with more individual contributors involved? > > > > Thanks, > > > > Andy. > > > > > > > > On Fri, Mar 23, 2018 at 9:11 AM, Wes McKinney > wrote: > > > >> Not knowing the Ru

Re: Rust bindings

2018-03-23 Thread Wes McKinney
al contributors involved? > > Thanks, > > Andy. > > > > On Fri, Mar 23, 2018 at 9:11 AM, Wes McKinney wrote: > >> Not knowing the Rust ecosystem very well, I'm interested in the >> pros/cons of building and maintaining Rust bindings vs. a native Rust >>

Re: Rust bindings

2018-03-23 Thread Andy Grove
, Mar 23, 2018 at 9:11 AM, Wes McKinney wrote: > Not knowing the Rust ecosystem very well, I'm interested in the > pros/cons of building and maintaining Rust bindings vs. a native Rust > implementation, or some hybrid of the two. Seems like both bindings > and native implementatio

Re: Rust bindings

2018-03-23 Thread Wes McKinney
Not knowing the Rust ecosystem very well, I'm interested in the pros/cons of building and maintaining Rust bindings vs. a native Rust implementation, or some hybrid of the two. Seems like both bindings and native implementation could be part of the same codebase potentially. If we deci

Re: Rust bindings

2018-03-23 Thread Andy Grove
t; > Get Outlook for iOS<https://aka.ms/o0ukef> > _ > From: Andy Grove > Sent: Friday, March 23, 2018 9:08 AM > Subject: Rust bindings > To: > > > Hi, > > Congratulations on the release of the Go bindings for Arrow. I think Rust > should be

Re: Rust bindings

2018-03-23 Thread tarush grover
Hi Andy/Paddy, I also want to get involved in contributing towards rust bindings. Request you to please add me also. Regards, Tarush On Fri, 23 Mar 2018 at 8:14 PM, paddy horan wrote: > Hi Andy, > > I’m looking to get involved in contributing to the Rust implementation > also, w

Re: Rust bindings

2018-03-23 Thread paddy horan
iOS<https://aka.ms/o0ukef> _ From: Andy Grove Sent: Friday, March 23, 2018 9:08 AM Subject: Rust bindings To: Hi, Congratulations on the release of the Go bindings for Arrow. I think Rust should be next ;-) I've been a bit distracted getting a release out

Rust bindings

2018-03-23 Thread Andy Grove
ekend on this. I don't think it will be very hard to get to a point where I am at least using the Array type. I can commit to working on the Rust bindings moving forward (weekends mostly) so I think we should go ahead and do this under the arrow repo if everyone is in agreement. Thanks, Andy,

[jira] [Created] (ARROW-2267) Rust bindings

2018-03-05 Thread Joshua Howard (JIRA)
Joshua Howard created ARROW-2267: Summary: Rust bindings Key: ARROW-2267 URL: https://issues.apache.org/jira/browse/ARROW-2267 Project: Apache Arrow Issue Type: New Feature