Hi Prem, I'd like to learn more about your needs here.
I mostly work on the Rust implementation but I work with the cuDF team in my day job at NVIDIA. I'll take a look at your PR on Monday. Thanks, Andy. On Fri, Mar 12, 2021, 3:47 PM Neal Richardson <neal.p.richard...@gmail.com> wrote: > I'll let others comment on a patch release, but let me clarify: we do major > releases quarterly, and 3.0.0 was in January, so 4.0.0 will be in April. > > Neal > > On Fri, Mar 12, 2021 at 2:45 PM Prem Sagar Gali <pg...@nvidia.com> wrote: > > > Hi Arrow Devs, > > > > I'm a maintainer of a project called cuDF ( > > https://github.com/rapidsai/cudf.git) that is based on the Arrow > columnar > > format and depends on the Arrow C++ and Python libraries. Currently, we > are > > pinned to version `1.0.1`, but we've gotten feedback from the community > > that they'd really like us to upgrade to the latest version. We tried to > > upgrade to version `3.0.0` but ran into a major issue: > > > > > > - GPU buffer validation fails in array and table creation code flows. > > Related JIRA is https://issues.apache.org/jira/browse/ARROW-11872 and > > subsequent PR fixing the issue is > > https://github.com/apache/arrow/pull/9640 and was merged a few days ago. > > Unfortunately, this effectively blocks most usage of Arrow libraries for > > CUDA projects. > > > > - After this, we tried version `2.0.0` but hit a different issue of > > round-tripping of list of structs columns doesn't work properly in the > > parquet reader and writer. This is fixed in version `3.0.0`. > > > > It seems like version `4.0.0` is tentatively scheduled for June 2021, > > which is unfortunately quite a bit away. Would it be possible to do a > patch > > release in `3.x` that included the fix for GPU buffer validation? This > > would greatly help us upgrade to the latest arrow version and directly > help > > users using both Arrow and cuDF. > > > > > > Regards, > > Prem > > >
