Hi Arrow Devs, >From the following road-map document I found, it appears to be that arrow 4.0 next major release is in June 2021 as opposed to April 2021.
https://docs.google.com/document/d/1qspsOM_dknOxJKdGvKbC1aoVoO0M3i6x1CIo58mmN2Y/edit# Quoting the document here: "...about plans for the 4.0 release of Apache Arrow (~June 2021)...." Did I run into the wrong document regarding the correct arrow 4.0 release date? I have connected with Andy and Keith offline and cuDF should be fine with waiting until `4.0.0` if the release is April 2021. Regards, Prem On Mon, Mar 15, 2021 at 10:54 AM Andy Grove <andygrov...@gmail.com> wrote: > Hi Prem, > > I didn't spot that this came from an NVIDIA email address when looking at > this email on my phone. I will ping you directly and report conclusions > back here. > > Thanks, > > Andy. > > On Fri, Mar 12, 2021 at 11:01 PM Andy Grove <andygrov...@gmail.com> wrote: > > > Hi Prem, > > > > I'd like to learn more about your needs here. > > > > I mostly work on the Rust implementation but I work with the cuDF team in > > my day job at NVIDIA. > > > > I'll take a look at your PR on Monday. > > > > Thanks, > > > > Andy. > > > > > > > > > > On Fri, Mar 12, 2021, 3:47 PM Neal Richardson < > neal.p.richard...@gmail.com> > > wrote: > > > >> I'll let others comment on a patch release, but let me clarify: we do > >> major > >> releases quarterly, and 3.0.0 was in January, so 4.0.0 will be in April. > >> > >> Neal > >> > >> On Fri, Mar 12, 2021 at 2:45 PM Prem Sagar Gali <pg...@nvidia.com> > wrote: > >> > >> > Hi Arrow Devs, > >> > > >> > I'm a maintainer of a project called cuDF ( > >> > https://github.com/rapidsai/cudf.git) that is based on the Arrow > >> columnar > >> > format and depends on the Arrow C++ and Python libraries. Currently, > we > >> are > >> > pinned to version `1.0.1`, but we've gotten feedback from the > community > >> > that they'd really like us to upgrade to the latest version. We tried > to > >> > upgrade to version `3.0.0` but ran into a major issue: > >> > > >> > > >> > - GPU buffer validation fails in array and table creation code flows. > >> > Related JIRA is https://issues.apache.org/jira/browse/ARROW-11872 and > >> > subsequent PR fixing the issue is > >> > https://github.com/apache/arrow/pull/9640 and was merged a few days > >> ago. > >> > Unfortunately, this effectively blocks most usage of Arrow libraries > for > >> > CUDA projects. > >> > > >> > - After this, we tried version `2.0.0` but hit a different issue of > >> > round-tripping of list of structs columns doesn't work properly in the > >> > parquet reader and writer. This is fixed in version `3.0.0`. > >> > > >> > It seems like version `4.0.0` is tentatively scheduled for June 2021, > >> > which is unfortunately quite a bit away. Would it be possible to do a > >> patch > >> > release in `3.x` that included the fix for GPU buffer validation? This > >> > would greatly help us upgrade to the latest arrow version and directly > >> help > >> > users using both Arrow and cuDF. > >> > > >> > > >> > Regards, > >> > Prem > >> > > >> > > >
