hi Jacques, I can say that I for one am excited to see this work happen in Apache Arrow, and I would like to contribute to the initiative. Some responses to queries inline:
On Mon, Jul 23, 2018 at 2:50 PM, Jacques Nadeau <jacq...@apache.org> wrote: > Hey All, > > As I mentioned on some other threads, since the start, the goal of the > Dremio team was to contribute the Gandiva back into the Arrow project once > we made some progress in turning it into something real. I think we're > getting close to this point and wanted to have a bit of a discussion about > this possible contribution. There are two main questions from my > perspective: > > 1) Does the community feel like this would be a good addition. I do; I think LLVM code generation is going to be an important part of future Arrow-based and Gandiva represents solid strides in the right direction. > 2) Will the Gandiva work continue to flourish inside of Arrow. Yes -- I think even if Dremio ceased development of Gandiva that there would be members of the community that would continue to develop it. I see Gandiva as a natural consequence of the kind of work happening in many other places, like the XLA linear algebra compiler in TensorFlow (https://www.tensorflow.org/performance/xla/). I've shown Gandiva now to several people in different communities and it seems obvious to people as something that needs to exist and be a key part of the ecosystem. > > With regards to (1), the announcement email on this list showed some > initial positive feedback. How are people feeling these days? Do people > think it makes sense for Gandiva to be part of the Arrow project? > > With regards to (2), there are two main questions. > a) How do we make sure the Gandiva team (who are not Arrow committers) get > ample support from other committers to make good continued progress. Since > they will no longer be able to commit code directly, others will need to > stand up and support them. I think several volunteered previously but just > want to confirm continued support for this. I'm happy to be responsive 6-7 days a week merging patches until some of the Gandiva developers can become committers. I won't speak for him, but Antoine Pitrou has significant experience with LLVM and should also be able to help with code review and patch merging. > > b) Do the Dremio requirements/expectations for Gandiva match with the Arrow > community's preferences? A couple of key requirements we have are to > support some older platforms: specifically Windows 7+, Centos 6+ and OSX. I > don't think this is incompatible with the existing Arrow stack but I > believe it may be lower platform requirements than some other components in > Arrow. Is this set of platform targets compatible with the Arrow project? Yes. As far as I understand it, we support: * Windows Vista and later (Windows XP EOL'd some time ago; it's not supported by Python distros anymore). We're only testing 64-bit Windows, I am not sure if 32-bit works * CentOS 6 and later (we use the RedHat devtoolset-2 compiler toolchain) * macOS 10.9 and later - Wes > > Thoughts?
