Noted, thanks. Will be in touch.
Matthew M. Turner
Email: matthew.m.tur...@outlook.com
Phone: (908)-868-2786
-Original Message-
From: Wes McKinney
Sent: Tuesday, February 18, 2020 3:30 AM
To: dev
Subject: Re: Arrow Datasets Functionality for Python
hi Matthew,
Thanks -- our
atthew.m.tur...@outlook.com
> Phone: (908)-868-2786
>
> -Original Message-
> From: Wes McKinney
> Sent: Monday, February 10, 2020 10:33 AM
> To: dev
> Subject: Re: Arrow Datasets Functionality for Python
>
> I will add that I'm interested in being involved wi
s all for the work and I look forward to all the developments
this year.
Best,
Matthew M. Turner
Email: matthew.m.tur...@outlook.com
Phone: (908)-868-2786
-Original Message-
From: Wes McKinney
Sent: Monday, February 10, 2020 10:33 AM
To: dev
Subject: Re: Arrow Datasets Functionalit
I will add that I'm interested in being involved with developing high
level Python interfaces to all of this functionality (e.g. using Ibis
[1]). It would be worth prototyping at least a datasets interface
layer for efficient data selection (predicate pushdown + filtering)
and then expanding to sup
Hello Matthew,
The dplyr binding is just syntactic sugar on top of the dataset API.
There's no analytics capabilities yet [1], other than the select and
the limited projection supported by the dataset API. It looks like it
is doing analytics due to properly placed `collect()` calls, which
converts
