I agree that this should be a separate project, so that this can be used by
other databases written in rust, not only datafusion. Let's start with an
implementation by binding with gandiva, and build pure rust implementation
later.
On Sat, May 11, 2019 at 10:28 PM Andy Grove wrote:
> Hi Renjie,
Hi Renjie,
I have not started on this but I would be interested in helping you with
it.
At a high level I think there are two main parts to this work:
1. Translating DataFusion expressions to Gandiva protobuf
2. Implementing the code to make the native C call to Gandiva
I could help with #1 pre
Hi:
@Andy Grove Are you developing this? I'm interested
in this and want to join development.
On Tue, Jan 8, 2019 at 3:18 PM Praveen Kumar wrote:
> Agree with Wes, the protobuf based interface should be the language neutral
> way to build expressions with Gandiva.
>
> On Mon, Jan 7, 2019 at 8:3
Agree with Wes, the protobuf based interface should be the language neutral
way to build expressions with Gandiva.
On Mon, Jan 7, 2019 at 8:30 PM Andy Grove wrote:
> This makes sense to me know that I understand a little more about Gandiva.
> This also fits well with my proposal to donate DataFu
This makes sense to me know that I understand a little more about Gandiva.
This also fits well with my proposal to donate DataFusion in the other
thread. DataFusion can manage the overall logical query plan in Rust and
potentially delegate some subset of expression evaluation to Gandiva via
protobu
Gandiva supports a Protobuf-based interface -- this is how Java
interacts with it via JNI. Rust could do the same -- that would
probably be easier than wrapping the C++ class structure. It would
also help drive new feature requirements in the serialized
projection/filter expression trees
- Wes
On
I'm not sure, that a binding is a good idea. Both Arrow and Parquet
already have their own rust implementation, and a interfacing with
cpp isn't as easy and straightforward than it is with C. Otherwise
We could simply just maintain bindings for all of the cpp libraries,
rather than of having a hybr
I have a patch up for Gandiva on Windows:
https://github.com/apache/arrow/pull/3295
It would be great to have the subgraph compiler available in Rust. You
should decide whether you want to require a C++ library that depends
on LLVM into all applications that use Rust and Arrow and need to
compute
Hey Andy,
I am very interested in this, I’m also looking into adding explicit SIMD to our
existing “array_ops”.
Maybe we can plan out what is needed on the developer wiki so that we can all
help out where we are able.
I’ve seen it mentioned here and there but what it the current state of gandi
