Wes, if you don't get to it today, I can try to update the docs tomorrow. Joris
On Thu, 10 Oct 2019 at 21:51, Neal Richardson <neal.p.richard...@gmail.com> wrote: > I updated the R docs because I had everything I needed to do that > locally: https://github.com/apache/arrow-site/pull/30 Doing the others > wasn't feasible for me on my computer (I don't have CUDA, and the case > insensitivity of the macOS file system always bites me with the > pyarrow docs anyway). > > IMO improving our CI/CD around documentation should be a priority for 1.0. > > Neal > > On Thu, Oct 10, 2019 at 12:03 PM Wes McKinney <wesmck...@gmail.com> wrote: > > > > The docs on http://arrow.apache.org/docs/ haven't been updated yet. > > This happened the last release, too -- I ended up updating the docs > > manually after a week or two. Is this included in the release > > management guide? If no one beats me to it, I can update the docs by > > hand again later today > > > > On Mon, Oct 7, 2019 at 6:20 PM Wes McKinney <wesmck...@gmail.com> wrote: > > > > > > I think we might be a little aggressive at removing artifacts from the > > > dist system > > > > > > Can we change our process to only remove old dist artifacts when we > > > are about to upload a new RC? Otherwise it's harder to make > > > improvements to the release verification scripts without any old RC to > > > test against > > > > > > On Mon, Oct 7, 2019 at 5:17 PM Neal Richardson > > > <neal.p.richard...@gmail.com> wrote: > > > > > > > > The R package has been accepted by CRAN. Binaries for macOS and > > > > Windows should become available in the next few days. > > > > > > > > Neal > > > > > > > > On Mon, Oct 7, 2019 at 1:41 AM Krisztián Szűcs > > > > <szucs.kriszt...@gmail.com> wrote: > > > > > > > > > > Thanks Andy! > > > > > > > > > > I've just removed the RC source artefacts from SVN. > > > > > > > > > > We have two remaining post release tasks: > > > > > - homebrew > > > > > - apidocs > > > > > > > > > > On Mon, Oct 7, 2019 at 1:47 AM Andy Grove <andygrov...@gmail.com> > wrote: > > > > > > > > > > > I released the Rust crates from the RC2 source tarball. I had to > comment > > > > > > out the benchmark references in the Cargo.toml first since the > tarball does > > > > > > not include the benchmark source code. I filed > > > > > > https://issues.apache.org/jira/browse/ARROW-6801 for this bug > and will > > > > > > fix the packaging before the 1.0.0 release. > > > > > > > > > > > > On Sun, Oct 6, 2019 at 2:01 AM Krisztián Szűcs < > szucs.kriszt...@gmail.com> > > > > > > wrote: > > > > > > > > > > > >> The rust publishing script fails because it cannot find the > benchmarks. > > > > > >> Seems to be related to cargo changes. > > > > > >> I cannot investigate it right now, @Andy could you take a look? > > > > > >> > > > > > >> On Sun, Oct 6, 2019, 9:11 AM Krisztián Szűcs < > szucs.kriszt...@gmail.com> > > > > > >> wrote: > > > > > >> > > > > > >>> - published js packages to npm, please check that they are > working > > > > > >>> properly > > > > > >>> > > > > > >>> On Sat, Oct 5, 2019 at 10:14 PM Neal Richardson < > > > > > >>> neal.p.richard...@gmail.com> wrote: > > > > > >>> > > > > > >>>> R release steps per > > > > > >>>> > > > > > >>>> > https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide#ReleaseManagementGuide-UpdatingRpackages > > > > > >>>> are underway. > > > > > >>>> > > > > > >>>> Neal > > > > > >>>> > > > > > >>>> On Sat, Oct 5, 2019 at 8:40 AM Krisztián Szűcs > > > > > >>>> <szucs.kriszt...@gmail.com> wrote: > > > > > >>>> > > > > > > >>>> > - website updated with the release notes > > > > > >>>> > - conda-forge updates are merged > > > > > >>>> > > > > > > >>>> > Remaining: > > > > > >>>> > - Javascript > > > > > >>>> > - Rust > > > > > >>>> > - R > > > > > >>>> > - Homebrew > > > > > >>>> > - Apidocs > > > > > >>>> > > > > > > >>>> > On Sat, Oct 5, 2019 at 2:58 PM Sutou Kouhei < > k...@clear-code.com> > > > > > >>>> wrote: > > > > > >>>> > > > > > > >>>> > > - uploaded C# packages > > > > > >>>> > > > > > > > >>>> > > In <CAHM19a6eoiMQZSuZ-29n7LBzHxZYxBigw= > > > > > >>>> t1k_vz68rcb3m...@mail.gmail.com> > > > > > >>>> > > "Re: [VOTE] Release Apache Arrow 0.15.0 - RC2" on Sat, > 5 Oct 2019 > > > > > >>>> > > 14:50:51 +0200, > > > > > >>>> > > Krisztián Szűcs <szucs.kriszt...@gmail.com> wrote: > > > > > >>>> > > > > > > > >>>> > > > - uploaded python wheels to pypi > > > > > >>>> > > > - uploaded java artifacts to maven central > > > > > >>>> > > > > > > > > >>>> > > > I'm going to update the conda recipes. > > > > > >>>> > > > > > > > > >>>> > > > Remaining: > > > > > >>>> > > > - Javascript > > > > > >>>> > > > - Rust > > > > > >>>> > > > - C# > > > > > >>>> > > > - R > > > > > >>>> > > > - Homebrew > > > > > >>>> > > > - Site > > > > > >>>> > > > > > > > > >>>> > > > > > > > > >>>> > > > > > > > > >>>> > > > On Sat, Oct 5, 2019 at 2:29 PM Krisztián Szűcs < > > > > > >>>> > > szucs.kriszt...@gmail.com> > > > > > >>>> > > > wrote: > > > > > >>>> > > > > > > > > >>>> > > >> - rebased master > > > > > >>>> > > >> - rebased the pull requests > > > > > >>>> > > >> - released the jira version > > > > > >>>> > > >> - started the new jira version > > > > > >>>> > > >> - uploaded source artifacts to svn > > > > > >>>> > > >> - uploaded binary artifacts to bintray > > > > > >>>> > > >> - currently uploading python wheels to pypi > > > > > >>>> > > >> > > > > > >>>> > > >> > > > > > >>>> > > >> On Sat, Oct 5, 2019 at 2:04 PM Sutou Kouhei < > k...@clear-code.com> > > > > > >>>> wrote: > > > > > >>>> > > >> > > > > > >>>> > > >>> I'll release RubyGems. > > > > > >>>> > > >>> > > > > > >>>> > > >>> In < > > > > > >>>> > cahm19a5pxw5mq5zgb7pxoerg9rkxrhmadcrpmkw12jkjokw...@mail.gmail.com > > > > > >>>> > > > > > > > > >>>> > > >>> "Re: [VOTE] Release Apache Arrow 0.15.0 - RC2" on > Sat, 5 Oct > > > > > >>>> 2019 > > > > > >>>> > > >>> 11:46:16 +0200, > > > > > >>>> > > >>> Krisztián Szűcs <szucs.kriszt...@gmail.com> wrote: > > > > > >>>> > > >>> > > > > > >>>> > > >>> > On Sat, Oct 5, 2019 at 11:40 AM Krisztián Szűcs < > > > > > >>>> > > >>> szucs.kriszt...@gmail.com> > > > > > >>>> > > >>> > wrote: > > > > > >>>> > > >>> > > > > > > >>>> > > >>> >> The VOTE carries with 5 binding +1 votes and 2 > non-binding > > > > > >>>> +1 votes. > > > > > >>>> > > >>> >> > > > > > >>>> > > >>> >> On Fri, Oct 4, 2019 at 10:04 PM Wes McKinney < > > > > > >>>> wesmck...@gmail.com> > > > > > >>>> > > >>> wrote: > > > > > >>>> > > >>> >> > > > > > >>>> > > >>> >>> The commits from your local RC branch aren't > available so I > > > > > >>>> cannot > > > > > >>>> > > >>> >>> rebase master yet, I'll just wait for you to be > available > > > > > >>>> again. > > > > > >>>> > > >>> >> > > > > > >>>> > > >>> >> Actually those commits are available under the tag. > > > > > >>>> > > >>> >> > > > > > >>>> > > >>> > The new version updates are indeed only available > locally. > > > > > >>>> I'm doing > > > > > >>>> > > the > > > > > >>>> > > >>> > rebase. > > > > > >>>> > > >>> > > > > > > >>>> > > >>> >> If anyone has some spare time we should try to > complete as > > > > > >>>> many > > > > > >>>> > > >>> >>> post-release tasks this weekend so we can > announce the > > > > > >>>> release on > > > > > >>>> > > >>> >>> Monday or Tuesday next week. > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> >> > > > > > >>>> > > >>> >> We have many post-release tasks, any help is > appreciated. > > > > > >>>> > > >>> >> > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> >>> Thanks all for your help getting this release > ready! > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> >>> On Fri, Oct 4, 2019 at 6:40 AM Krisztián Szűcs > > > > > >>>> > > >>> >>> <szucs.kriszt...@gmail.com> wrote: > > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > We have 5 binding +1 votes and 2 non-binding +1 > votes so > > > > > >>>> far. > > > > > >>>> > > >>> >>> > The 72 hours has passed, so we can close the > release vote. > > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > Sadly I won't be available for the rest of the > day, so I > > > > > >>>> will be > > > > > >>>> > > >>> able > > > > > >>>> > > >>> >>> > to close the vote and start to work on the the > post > > > > > >>>> release tasks > > > > > >>>> > > >>> >>> > from tomorrow. > > > > > >>>> > > >>> >>> > @Wes if you have bandwidth feel free to close > the vote > > > > > >>>> sooner. > > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > On Thu, Oct 3, 2019 at 1:14 AM Bryan Cutler < > > > > > >>>> cutl...@gmail.com> > > > > > >>>> > > >>> wrote: > > > > > >>>> > > >>> >>> > > > > > > >>>> > > >>> >>> > > Accidentally sent too soon. The ORC build > error I got > > > > > >>>> was > > > > > >>>> > > probably > > > > > >>>> > > >>> >>> just an > > > > > >>>> > > >>> >>> > > env issue for me, but here it is in case > anyone else > > > > > >>>> had the > > > > > >>>> > > same > > > > > >>>> > > >>> >>> issue: > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > In file included from > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> > > > > > >>>> > > > > > > > >>>> > ESC[01mESC[K/tmp/arrow-0.15.0.KxYbA/apache-arrow-0.15.0/cpp/build/orc_ep-prefix/src/orc_ep/c++/src/wrap/orc-proto-wrapper.cc:44:0ESC[mESC[K: > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> > > > > > >>>> > > > > > > > >>>> > ESC[01mESC[K/tmp/arrow-0.15.0.KxYbA/apache-arrow-0.15.0/cpp/build/orc_ep-prefix/src/orc_ep-build/c++/src/ > > > > > >>>> > > >>> >>> orc_proto.pb.cc:970 > > > > > >>>> > > >>> >>> > > :13:ESC[mESC[K > > > > > >>>> > > >>> >>> > > ESC[01;31mESC[Kerror: > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> > > > > > >>>> > > > > > > > >>>> > ESC[mESC[K‘ESC[01mESC[Kdynamic_init_dummy_orc_5fproto_2eprotoESC[mESC[K’ > > > > > >>>> > > >>> >>> > > defined but not used [-Werror=unused-variable] > > > > > >>>> > > >>> >>> > > static bool > dynamic_init_dummy_orc_5fproto_2eproto = > > > > > >>>> []() { > > > > > >>>> > > >>> >>> > > AddDescriptors_orc_5fproto_2eproto(); return > true; }(); > > > > > >>>> > > >>> >>> > > ESC[01;32mESC[K ^ESC[mESC[K > > > > > >>>> > > >>> >>> > > cc1plus: all warnings being treated as errors > > > > > >>>> > > >>> >>> > > make[5]: *** > > > > > >>>> > > >>> > [c++/src/CMakeFiles/orc.dir/wrap/orc-proto-wrapper.cc.o] > > > > > >>>> > > >>> >>> Error > > > > > >>>> > > >>> >>> > > 1 > > > > > >>>> > > >>> >>> > > make[5]: *** Waiting for unfinished jobs.... > > > > > >>>> > > >>> >>> > > make[4]: *** [c++/src/CMakeFiles/orc.dir/all] > Error 2 > > > > > >>>> > > >>> >>> > > make[3]: *** [all] Error 2 > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > [ 29%] Performing build step for 'orc_ep' > > > > > >>>> > > >>> >>> > > CMake Error at > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> > > > > > >>>> > > > > > > > >>>> > /tmp/arrow-0.15.0.KxYbA/apache-arrow-0.15.0/cpp/build/orc_ep-prefix/src/orc_ep-stamp/orc_ep-build-RELEASE.cmake:16 > > > > > >>>> > > >>> >>> > > (message): > > > > > >>>> > > >>> >>> > > Command failed: 2 > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > 'make' > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > See also > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> > > > > > >>>> > > > > > > > >>>> > /tmp/arrow-0.15.0.KxYbA/apache-arrow-0.15.0/cpp/build/orc_ep-prefix/src/orc_ep-stamp/orc_ep-build-*.log > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > CMakeFiles/orc_ep.dir/build.make:111: recipe > for target > > > > > >>>> > > >>> >>> > > 'orc_ep-prefix/src/orc_ep-stamp/orc_ep-build' > failed > > > > > >>>> > > >>> >>> > > make[2]: *** > > > > > >>>> [orc_ep-prefix/src/orc_ep-stamp/orc_ep-build] > > > > > >>>> > > Error 1 > > > > > >>>> > > >>> >>> > > CMakeFiles/Makefile2:1248: recipe for target > > > > > >>>> > > >>> >>> 'CMakeFiles/orc_ep.dir/all' > > > > > >>>> > > >>> >>> > > failed > > > > > >>>> > > >>> >>> > > make[1]: *** [CMakeFiles/orc_ep.dir/all] > Error 2 > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > On Wed, Oct 2, 2019 at 4:12 PM Bryan Cutler < > > > > > >>>> cutl...@gmail.com > > > > > >>>> > > > > > > > > >>>> > > >>> >>> wrote: > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > +1 (non-binding) > > > > > >>>> > > >>> >>> > > > > > > > > >>>> > > >>> >>> > > > I ran the following on Ubuntu 16.04 > 4.15.0-64-generic: > > > > > >>>> > > >>> >>> > > > > dev/release/verify-release-candidate.sh > binaries > > > > > >>>> 0.15.0 2 > > > > > >>>> > > >>> >>> > > > > ARROW_CUDA=OFF \ > > > > > >>>> > > >>> >>> > > > TEST_DEFAULT=0 \ > > > > > >>>> > > >>> >>> > > > TEST_SOURCE=1 \ > > > > > >>>> > > >>> >>> > > > TEST_CPP=1 \ > > > > > >>>> > > >>> >>> > > > TEST_PYTHON=1 \ > > > > > >>>> > > >>> >>> > > > TEST_JAVA=1 \ > > > > > >>>> > > >>> >>> > > > TEST_INTEGRATION=1 \ > > > > > >>>> > > >>> >>> > > > dev/release/verify-release-candidate.sh > source 0.15.0 > > > > > >>>> 2 > > > > > >>>> > > >>> >>> > > > > > > > > >>>> > > >>> >>> > > > For source verification I set > > > > > >>>> > > >>> INTEGRATION_TEST_ARGS="--enable-js=0 > > > > > >>>> > > >>> >>> > > > --enable-go=0" > > > > > >>>> > > >>> >>> > > > > > > > > >>>> > > >>> >>> > > > When attempting source verification with > defaults, I > > > > > >>>> got the > > > > > >>>> > > >>> below > > > > > >>>> > > >>> >>> error > > > > > >>>> > > >>> >>> > > > when building the ORC adapter. It looks > like just a > > > > > >>>> warning > > > > > >>>> > > >>> that is > > > > > >>>> > > >>> >>> being > > > > > >>>> > > >>> >>> > > > treated as error and seems to be only in > > > > > >>>> > > >>> >>> > > > > > > > > >>>> > > >>> >>> > > > On Wed, Oct 2, 2019 at 7:53 AM Andy Grove < > > > > > >>>> > > >>> andygrov...@gmail.com> > > > > > >>>> > > >>> >>> wrote: > > > > > >>>> > > >>> >>> > > > > > > > > >>>> > > >>> >>> > > >> +1 (binding) > > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> On Mon, Sep 30, 2019 at 11:57 PM Krisztián > Szűcs < > > > > > >>>> > > >>> >>> > > >> szucs.kriszt...@gmail.com> > > > > > >>>> > > >>> >>> > > >> wrote: > > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > >> > Hi, > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > I would like to propose the following > release > > > > > >>>> candidate > > > > > >>>> > > >>> (RC2) of > > > > > >>>> > > >>> >>> > > Apache > > > > > >>>> > > >>> >>> > > >> > Arrow version 0.15.0. This is a release > consiting > > > > > >>>> of 697 > > > > > >>>> > > >>> >>> > > >> > resolved JIRA issues[1]. > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > This release candidate is based on > commit: > > > > > >>>> > > >>> >>> > > >> > 40d468e162e88e1761b1e80b3ead060f0be927ee > [2] > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > The source release rc2 is hosted at [3]. > > > > > >>>> > > >>> >>> > > >> > The binary artifacts are hosted at > [4][5][6][7]. > > > > > >>>> > > >>> >>> > > >> > The changelog is located at [8]. > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > Please download, verify checksums and > signatures, > > > > > >>>> run the > > > > > >>>> > > >>> unit > > > > > >>>> > > >>> >>> tests, > > > > > >>>> > > >>> >>> > > >> > and vote on the release. See [9] for how > to > > > > > >>>> validate a > > > > > >>>> > > >>> release > > > > > >>>> > > >>> >>> > > >> candidate. > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > The vote will be open for at least 72 > hours. > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > [ ] +1 Release this as Apache Arrow > 0.15.0 > > > > > >>>> > > >>> >>> > > >> > [ ] +0 > > > > > >>>> > > >>> >>> > > >> > [ ] -1 Do not release this as Apache > Arrow 0.15.0 > > > > > >>>> > > because... > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > [1]: > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> > > > > > >>>> > > > > > > > >>>> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0 > > > > > >>>> > > >>> >>> > > >> > [2]: > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> > > > > > >>>> > > > > > > > >>>> > https://github.com/apache/arrow/tree/40d468e162e88e1761b1e80b3ead060f0be927ee > > > > > >>>> > > >>> >>> > > >> > [3]: > > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > > > > >>>> > > > > > > > >>>> > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc2 > > > > > >>>> > > >>> >>> > > >> > [4]: > > > > > >>>> > > https://bintray.com/apache/arrow/centos-rc/0.15.0-rc2 > > > > > >>>> > > >>> >>> > > >> > [5]: > > > > > >>>> > > https://bintray.com/apache/arrow/debian-rc/0.15.0-rc2 > > > > > >>>> > > >>> >>> > > >> > [6]: > > > > > >>>> > > https://bintray.com/apache/arrow/python-rc/0.15.0-rc2 > > > > > >>>> > > >>> >>> > > >> > [7]: > > > > > >>>> > > https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc2 > > > > > >>>> > > >>> >>> > > >> > [8]: > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> > > > > > >>>> > > > > > > > >>>> > https://github.com/apache/arrow/blob/40d468e162e88e1761b1e80b3ead060f0be927ee/CHANGELOG.md > > > > > >>>> > > >>> >>> > > >> > [9]: > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> > > > > > >>>> > > > > > > > >>>> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates > > > > > >>>> > > >>> >>> > > >> > > > > > > >>>> > > >>> >>> > > >> > > > > > >>>> > > >>> >>> > > > > > > > > >>>> > > >>> >>> > > > > > > > >>>> > > >>> >>> > > > > > >>>> > > >>> >> > > > > > >>>> > > >>> > > > > > >>>> > > >> > > > > > >>>> > > > > > > > >>>> > > > > > >>> >