Re: Timeline for Arrow 0.12.0 release

2019-01-10 Thread Wes McKinney
> with > >>>>>>>>>>>>> Gandiva. I can see that each language should be able to > >>>>>>> construct > >>>>>>>>> the > >>>>>>>>>>>>> logical query plan to submit to Gandiva and let Gandiva handle > >>>>>>>&

Re: Timeline for Arrow 0.12.0 release

2019-01-10 Thread Antoine Pitrou
t;> language-specific >>>>>>>>>>>>> lambda functions as part of that logical query plan. Maybe it is >>>>>>>>> possible >>>>>>>>>>>>> to compile the lambda down to LLVM (I haven't started lea

Re: Timeline for Arrow 0.12.0 release

2019-01-09 Thread Wes McKinney
;>>>>> supports this with zero overhead). > >>>>>>>>>>> > >>>>>>>>>>> Andy. > >>>>>>>>>>> > >>>>>>>>>>> > >>>>>>>>&g

Re: Timeline for Arrow 0.12.0 release

2019-01-09 Thread Antoine Pitrou
>>>>>>>>>>> Andy. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Sun, Dec 9, 2018 at 11:42 AM Wes McKinney < >>>>> wesmck.

Re: Timeline for Arrow 0.12.0 release

2019-01-09 Thread Krisztián Szűcs
e things that Gandiva has begun is a > >>>>>>>>>> Protobuf-based serialized representation representation of > >>>>> projection > >>>>>>>>>> and filter expressions. In the long run I would like to see a > >&

Re: Timeline for Arrow 0.12.0 release

2019-01-09 Thread Antoine Pitrou
execution. There's complexities, though, such as bridging >>>>>>>>>> iteration of data sources written in Rust, say, with a query >>> engine >>>>>>>>>> written in C++. You would need to provide some kind of a >>> call

Re: Timeline for Arrow 0.12.0 release

2019-01-08 Thread Wes McKinney
ts are do-ocracies. > > > > > > >>> > > > > > > >>> - Wes > > > > > > >>> On Fri, Dec 7, 2018 at 6:22 AM Andy Grove < > > andygrov...@gmail.com> > > > > wrote: > > > > > > >&

Re: Timeline for Arrow 0.12.0 release

2019-01-07 Thread Krisztián Szűcs
t; > > > > >>> On Fri, Dec 7, 2018 at 6:22 AM Andy Grove < > andygrov...@gmail.com> > > > wrote: > > > > > >>>> > > > > > >>>> I've added one PR to the list ( > > > https://github.com/apache/arrow/pull/3119 > > > > > >>> ) >

Re: Timeline for Arrow 0.12.0 release

2019-01-07 Thread Wes McKinney
> >>>> to update the project to use Rust 2018 Edition. > > > > >>>> > > > > >>>> I'm also considering removing one PR from the list and would like > > to get > > > > >>>> opinions here. > > > > >>>> > > > > >>>> I have a PR (https://github.com/apache/a

Re: Timeline for Arrow 0.12.0 release

2019-01-07 Thread Krisztián Szűcs
> > > >>> basic > > > >>>> math and comparison operators to primitive arrays. These are baby > steps > > > >>>> towards implementing more query execution capabilities such as > > > >>> projection, > > > >>>> se

Re: Timeline for Arrow 0.12.0 release

2019-01-04 Thread Wes McKinney
c but Chao made a good point that other Rust > > >>>> implementations > > >>>> don't have these kind of capabilities and I am now wondering if this > > >>>> is a > > >>>> distraction. We already have Gandiva and the new efforts

Re: Timeline for Arrow 0.12.0 release

2018-12-12 Thread Wes McKinney
he new efforts in Ursa labs and > >>>> it would probably make more sense to look at having Rust bindings for the > >>>> query execution capabilities there rather than having a competing (and > >>> less > >>>> capable) implementation in Rust.

Re: Timeline for Arrow 0.12.0 release

2018-12-12 Thread Antoine Pitrou
t would probably make more sense to look at having Rust bindings for the >>>> query execution capabilities there rather than having a competing (and >>> less >>>> capable) implementation in Rust. >>>> >>>> Thoughts? >>>> >>>

Re: Timeline for Arrow 0.12.0 release

2018-12-12 Thread Jacques Nadeau
> > Thoughts? > > > > > > > > Andy. > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Dec 6, 2018 at 8:42 PM paddy horan > > > wrote: > > > > > > > > > Ot

Re: Timeline for Arrow 0.12.0 release

2018-12-11 Thread Wes McKinney
r than Andy’s PR below I’m going to try and find time to work on > > > > ARROW-3827, I’ll bump it 0.13 if I can’t find the time early next week. > > > > There is nothing else in the 0.12 backlog for Rust. It would be nice > > to > > > > get the parquet merg

Analytics in Rust [was Re: Timeline for Arrow 0.12.0 release]

2018-12-10 Thread Wes McKinney
:42 PM paddy horan > > wrote: > > > > > > > Other than Andy’s PR below I’m going to try and find time to work on > > > > ARROW-3827, I’ll bump it 0.13 if I can’t find the time early next week. > > > > There is nothing else in the 0.12 backlog for Rust.

Re: Timeline for Arrow 0.12.0 release

2018-12-10 Thread Andy Grove
0.12 backlog for Rust. It would be nice > to > > > get the parquet merge in though. > > > > > > > > > > > > Paddy > > > > > > > > > > > > > > > From: Andy Grove > > >

Re: Timeline for Arrow 0.12.0 release

2018-12-09 Thread Wes McKinney
hing else in the 0.12 backlog for Rust. It would be nice to > > get the parquet merge in though. > > > > > > > > Paddy > > > > > > > > ________ > > From: Andy Grove > > Sent: Thursday, December 6, 2018 10

Re: Timeline for Arrow 0.12.0 release

2018-12-07 Thread Andy Grove
ge in though. > > > > Paddy > > > > > From: Andy Grove > Sent: Thursday, December 6, 2018 10:20:48 AM > To: dev@arrow.apache.org > Subject: Re: Timeline for Arrow 0.12.0 release > > I have PRs pending for all the Rust issues that I want to

RE: Timeline for Arrow 0.12.0 release

2018-12-06 Thread paddy horan
From: Andy Grove Sent: Thursday, December 6, 2018 10:20:48 AM To: dev@arrow.apache.org Subject: Re: Timeline for Arrow 0.12.0 release I have PRs pending for all the Rust issues that I want to get into 0.12.0 and would appreciate some reviews so I can go ahead and merge: https://github.com/apache

Re: Timeline for Arrow 0.12.0 release

2018-12-06 Thread Andy Grove
I have PRs pending for all the Rust issues that I want to get into 0.12.0 and would appreciate some reviews so I can go ahead and merge: https://github.com/apache/arrow/pull/3033 (covers ARROW-3880 and ARROW-3881 - add math and comparison operations to primitive arrays) https://github.com/apache/a

Re: Timeline for Arrow 0.12.0 release

2018-12-05 Thread paddy horan
meline for Arrow 0.12.0 release I'd love to tackle the three related issues for supporting simple math/comparison operations on primitive arrays and casting primitive arrays but since the change to use Rust specialization feature I'm a bit stuck and need some assistance applying the math o

Re: Timeline for Arrow 0.12.0 release

2018-12-04 Thread Andy Grove
I'd love to tackle the three related issues for supporting simple math/comparison operations on primitive arrays and casting primitive arrays but since the change to use Rust specialization feature I'm a bit stuck and need some assistance applying the math operations to the numeric types and not th

Re: Timeline for Arrow 0.12.0 release

2018-12-04 Thread Wes McKinney
Andy, Paddy, or other Rust developers -- could you review the 6 issues in TODO in the 0.12 backlog and either assign them or move them to the next release if they aren't going to be completed this week or next? On Fri, Nov 30, 2018 at 4:34 PM Wes McKinney wrote: > > hi folks, > > Tomorrow is Dec

Timeline for Arrow 0.12.0 release

2018-11-30 Thread Wes McKinney
hi folks, Tomorrow is December 1. The last major Arrow release (0.11.0) took place on October 8. Given how much work has happened in the project in the last ~2 months, I think it would be great to complete the next major release before the end-of-year holidays set in. I've been curating the JIRA