Re: Two proposals for expanding arrow Table API (virtual arrays and random access)

2020-06-17 Thread Neal Richardson
Maybe a draft pull request? If you put "WIP" in the pull request title, CI won't run builds on it, so it's suitable for rough outlines and collecting feedback. Neal On Wed, Jun 17, 2020 at 2:57 PM Radu Teodorescu wrote: > Thank you Wes! > Yes, both proposals fit very nicely in your Data Frames

Re: Two proposals for expanding arrow Table API (virtual arrays and random access)

2020-06-17 Thread Radu Teodorescu
Thank you Wes! Yes, both proposals fit very nicely in your Data Frames vision, I see them as deep dives on some specifics: - the virtual array doc is more fluffy an probably if you agree with the general concept, the next logical move is to put out some interfaces indeed - the random access doc g

Re: Two proposals for expanding arrow Table API (virtual arrays and random access)

2020-06-17 Thread Wes McKinney
hi Radu, I'll read the proposals in more detail when I can and make comments, but this has always been something of interest (see, e.g. [1]). The intent with the "C++ data frames" project that we've discussed (and I continue to labor towards, e.g. recent compute engine work is directly in service