Hi Prem, I didn't spot that this came from an NVIDIA email address when looking at this email on my phone. I will ping you directly and report conclusions back here.
Thanks, Andy. On Fri, Mar 12, 2021 at 11:01 PM Andy Grove <andygrov...@gmail.com> wrote: > Hi Prem, > > I'd like to learn more about your needs here. > > I mostly work on the Rust implementation but I work with the cuDF team in > my day job at NVIDIA. > > I'll take a look at your PR on Monday. > > Thanks, > > Andy. > > > > > On Fri, Mar 12, 2021, 3:47 PM Neal Richardson <neal.p.richard...@gmail.com> > wrote: > >> I'll let others comment on a patch release, but let me clarify: we do >> major >> releases quarterly, and 3.0.0 was in January, so 4.0.0 will be in April. >> >> Neal >> >> On Fri, Mar 12, 2021 at 2:45 PM Prem Sagar Gali <pg...@nvidia.com> wrote: >> >> > Hi Arrow Devs, >> > >> > I'm a maintainer of a project called cuDF ( >> > https://github.com/rapidsai/cudf.git) that is based on the Arrow >> columnar >> > format and depends on the Arrow C++ and Python libraries. Currently, we >> are >> > pinned to version `1.0.1`, but we've gotten feedback from the community >> > that they'd really like us to upgrade to the latest version. We tried to >> > upgrade to version `3.0.0` but ran into a major issue: >> > >> > >> > - GPU buffer validation fails in array and table creation code flows. >> > Related JIRA is https://issues.apache.org/jira/browse/ARROW-11872 and >> > subsequent PR fixing the issue is >> > https://github.com/apache/arrow/pull/9640 and was merged a few days >> ago. >> > Unfortunately, this effectively blocks most usage of Arrow libraries for >> > CUDA projects. >> > >> > - After this, we tried version `2.0.0` but hit a different issue of >> > round-tripping of list of structs columns doesn't work properly in the >> > parquet reader and writer. This is fixed in version `3.0.0`. >> > >> > It seems like version `4.0.0` is tentatively scheduled for June 2021, >> > which is unfortunately quite a bit away. Would it be possible to do a >> patch >> > release in `3.x` that included the fix for GPU buffer validation? This >> > would greatly help us upgrade to the latest arrow version and directly >> help >> > users using both Arrow and cuDF. >> > >> > >> > Regards, >> > Prem >> > >> >