By the way -- I think we should probably keep 2-5 past releases in the dist system so we avoid breaking packaging builds that are depending on the mirror system. This already caused an issue resulting in Arrow being removed from Homebrew (https://issues.apache.org/jira/browse/ARROW-4300), though the root cause of that was that the recipe was not being properly maintained by the Arrow community.
On Sat, Jan 19, 2019 at 7:39 PM Wes McKinney <wesmck...@gmail.com> wrote: > > Who can take care of updating the documentation? It needs to be built > on a machine with CUDA so I can do it if no one else is available. The > website and publishing workflow will need to be slightly updated so > that the top-level docs are published to arrow.apache.org/docs instead > of arrow.apache.org/python as it is now > > On Sat, Jan 19, 2019 at 3:08 PM Kouhei Sutou <k...@clear-code.com> wrote: > > > > Hi, > > > > I've published all Ruby packages. > > > > Thanks, > > -- > > kou > > > > In <CAJEf=x5sphovpj4itlm949hwczxwr47g0hzzsnfvsjxgdjr...@mail.gmail.com> > > "Re: [RESULT] [VOTE] Release Apache Arrow 0.12.0 RC4" on Sat, 19 Jan 2019 > > 13:45:12 -0700, > > Andy Grove <andygrov...@gmail.com> wrote: > > > > > I've published the Arrow crate (Rust) to crates.io > > > > > > https://crates.io/crates/arrow > > > > > > Chao will need to now publish the parquet crate. > > > > > > I will start a separate thread about adding other owners to crates.io for > > > these crates. > > > > > > Thanks, > > > > > > Andy. > > > > > > On Sat, Jan 19, 2019 at 12:23 PM Krisztián Szűcs > > > <szucs.kriszt...@gmail.com> > > > wrote: > > > > > >> I've uploaded the source archive to SVN and the binaries to bintray. > > >> > > >> On Sat, Jan 19, 2019 at 5:33 PM Uwe L. Korn <m...@uwekorn.com> wrote: > > >> > > >> > I can help with the conda-forge packages. > > >> > > > >> > Uwe > > >> > > > >> > On Sat, Jan 19, 2019, at 5:21 PM, Wes McKinney wrote: > > >> > > The vote carries with 3 binding +1 votes. Thanks to everyone for > > >> > > helping verify the release > > >> > > > > >> > > There are a number of post-release tasks in > > >> > > > > >> > > > > >> > > > >> https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide > > >> > > > > >> > > I will rebase the master branch right now. I can draft a blog post > > >> > > announcing the release to be sent out on Monday. Who can help with > > >> > > the > > >> > > other items? > > >> > > > > >> > > Thank you > > >> > > Wes > > >> > > > > >> > > On Fri, Jan 18, 2019 at 5:48 PM Andrew Palumbo <ap....@outlook.com> > > >> > wrote: > > >> > > > > > >> > > > My mistake I missed the note about using the verify script from > > >> master. > > >> > > > > > >> > > > On Jan 18, 2019 3:38 PM, Andrew Palumbo <ap....@outlook.com> wrote: > > >> > > > I seem have been failing here: > > >> > > > > > >> > > > ../../../release/libgandiva.so.12.0.0: undefined reference to > > >> > `llvm::sys::DynamicLibrary::getPermanentLibrary(char const*, > > >> std::string*)' > > >> > > > collect2: error: ld returned 1 exit status > > >> > > > > > >> src/gandiva/tests/CMakeFiles/gandiva-date_time_test.dir/build.make:94: > > >> > recipe for target 'release/gandiva-date_time_test' failed > > >> > > > make[2]: *** [release/gandiva-date_time_test] Error 1 > > >> > > > CMakeFiles/Makefile2:8836: recipe for target > > >> > 'src/gandiva/tests/CMakeFiles/gandiva-date_time_test.dir/all' failed > > >> > > > make[1]: *** > > >> > [src/gandiva/tests/CMakeFiles/gandiva-date_time_test.dir/all] Error 2 > > >> > > > [ 63%] Linking CXX executable > > >> > > > ../../../release/gandiva-projector_test > > >> > > > ../../../release/libgandiva.so.12.0.0: undefined reference to > > >> > `llvm::sys::DynamicLibrary::getPermanentLibrary(char const*, > > >> std::string*)' > > >> > > > collect2: error: ld returned 1 exit status > > >> > > > > > >> src/gandiva/tests/CMakeFiles/gandiva-projector_test.dir/build.make:94: > > >> > recipe for target 'release/gandiva-projector_test' failed > > >> > > > make[2]: *** [release/gandiva-projector_test] Error 1 > > >> > > > CMakeFiles/Makefile2:8627: recipe for target > > >> > 'src/gandiva/tests/CMakeFiles/gandiva-projector_test.dir/all' failed > > >> > > > make[1]: *** > > >> > [src/gandiva/tests/CMakeFiles/gandiva-projector_test.dir/all] Error 2 > > >> > > > [ 63%] Linking CXX executable > > >> > ../../../release/gandiva-projector_test_static > > >> > > > ../../../release/libgandiva.a(engine.cc.o): In function > > >> > `gandiva::Engine::InitOnce()': > > >> > > > engine.cc:(.text+0x537): undefined reference to > > >> > `llvm::sys::DynamicLibrary::getPermanentLibrary(char const*, > > >> std::string*)' > > >> > > > collect2: error: ld returned 1 exit status > > >> > > > > > >> > > > >> src/gandiva/tests/CMakeFiles/gandiva-projector_test_static.dir/build.make:147: > > >> > recipe for target 'release/gandiva-projector_test_static' failed > > >> > > > make[2]: *** [release/gandiva-projector_test_static] Error 1 > > >> > > > CMakeFiles/Makefile2:8756: recipe for target > > >> > 'src/gandiva/tests/CMakeFiles/gandiva-projector_test_static.dir/all' > > >> failed > > >> > > > make[1]: *** > > >> > [src/gandiva/tests/CMakeFiles/gandiva-projector_test_static.dir/all] > > >> Error 2 > > >> > > > Makefile:140: recipe for target 'all' failed > > >> > > > make: *** [all] Error 2 > > >> > > > + cleanup > > >> > > > + rm -fr /tmp/arrow-0.12.0.mC5MI > > >> > > > > > >> > > > running: > > >> > > > > > >> > > > > > >> > > > dev/release/verify-release-candidate.sh source 0.12.0 4 > > >> > > > > > >> > > > > > >> > > > > > >> > > > might want to take with a grain of salt, my system may not be > > >> > configured correctly. Are there any new dependencies necessary since > > >> RC2? > > >> > > > > > >> > > > --andy > > >> > > > ________________________________ > > >> > > > From: Wes McKinney <wesmck...@gmail.com> > > >> > > > Sent: Thursday, January 17, 2019 5:51 PM > > >> > > > To: dev@arrow.apache.org > > >> > > > Subject: Re: [VOTE] Release Apache Arrow 0.12.0 RC4 > > >> > > > > > >> > > > +1 (binding) > > >> > > > > > >> > > > * Ran verification script with Ubuntu 14.04, JDK8, Node 11.6 > > >> > > > (installed with nvm, which I guess sets up npx), gcc 4.8 > > >> > > > * Ran verification script on Windows 10 / MSVC 2015 with a minor > > >> > > > change to turn on the unit tests > > >> > > > > > >> > > > >> https://github.com/apache/arrow/commit/0f8bd747468dd28c909ef823bed77d8082a5b373 > > >> > > > > > >> > > > Thanks to Krisztian and everyone else for the help on this release > > >> > > > > > >> > > > On Thu, Jan 17, 2019 at 11:59 AM Antoine Pitrou > > >> > > > <anto...@python.org> > > >> > wrote: > > >> > > > > > > >> > > > > > > >> > > > > +1 (binding) > > >> > > > > > > >> > > > > I ran "./dev/release/verify-release-candidate.sh source 0.12.0 > > >> > > > > 4". > > >> > > > > Everything succeeded before JS, which failed > > >> > > > > ("./dev/release/verify-release-candidate.sh: ligne 258: npx : > > >> > commande > > >> > > > > introuvable"). > > >> > > > > > > >> > > > > - Ubuntu 18.04.1 (x86-64) > > >> > > > > - CUDA enabled > > >> > > > > - gcc 7.3.0 > > >> > > > > - java version "1.8.0_201" > > >> > > > > Java(TM) SE Runtime Environment (build 1.8.0_201-b09) > > >> > > > > Java HotSpot(TM) 64-Bit Server VM (build 25.201-b09, mixed mode) > > >> > > > > > > >> > > > > Regards > > >> > > > > > > >> > > > > Antoine. > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > Le 17/01/2019 à 18:03, Bryan Cutler a écrit : > > >> > > > > > +1 > > >> > > > > > > > >> > > > > > I ran ARROW_HAVE_CUDA=NO > > >> > > > > > dev/release/verify-release-candidate.sh > > >> > source > > >> > > > > > 0.12.0 4 > > >> > > > > > > > >> > > > > > - 4.15.0-43-generic #46~16.04.1-Ubuntu > > >> > > > > > - openjdk version "1.8.0_191" > > >> > > > > > - gcc version 5.4.0 > > >> > > > > > > > >> > > > > > I also ran Spark integration tests and was able to get all > > >> > > > > > tests > > >> > passing > > >> > > > > > after some minor modifications. > > >> > > > > > > > >> > > > > > Bryan > > >> > > > > > > > >> > > > > > On Thu, Jan 17, 2019 at 12:48 AM Kouhei Sutou < > > >> k...@clear-code.com> > > >> > wrote: > > >> > > > > > > > >> > > > > >> +1 (binding) > > >> > > > > >> > > >> > > > > >> I ran the followings on Debian GNU/Linux sid: > > >> > > > > >> > > >> > > > > >> * CC=gcc-7 CXX=g++-7 dev/release/verify-release-candidate.sh > > >> > source > > >> > > > > >> 0.12.0 4 > > >> > > > > >> * dev/release/verify-release-candidate.sh binaries 0.12.0 4 > > >> > > > > >> > > >> > > > > >> with: > > >> > > > > >> > > >> > > > > >> * gcc-7 (Debian 7.4.0-2) 7.4.0 > > >> > > > > >> * openjdk version "1.8.0_191" > > >> > > > > >> * ruby 2.7.0dev (2019-01-17 trunk 66841) [x86_64-linux] > > >> > > > > >> * nvidia-cuda-dev 9.2.148-5 > > >> > > > > >> > > >> > > > > >> I couldn't run JavaScript tests and integration tests with > > >> > > > > >> JavaScript because I couldn't prepare workable Node.js 11. > > >> > > > > >> (I can prepare workable Node.js 10.15.) > > >> > > > > >> > > >> > > > > >> RC4 includes JavaScript update > > >> > > > > >> > > >> > > > > >> > > >> > > > >> https://github.com/apache/arrow/commit/5598d2f42573ed19e7db4aae7adb02af2cd4ccd0 > > >> > > > > >> . It requires Node.js 11. > > >> > > > > >> > > >> > > > > >> I think that JavaScript implementation isn't important in > > >> > > > > >> this release. Because we still release JavaScript > > >> > > > > >> implementation separately. > > >> > > > > >> > > >> > > > > >> I hope that 0.13.0 release includes JavaScript > > >> > > > > >> implementation. > > >> > > > > >> > > >> > > > > >> > > >> > > > > >> Thanks, > > >> > > > > >> -- > > >> > > > > >> kou > > >> > > > > >> > > >> > > > > >> In < > > >> > cahm19a46rwdzozw_htfqjhcoj6ou2nyj1ms_90-j4eru5jz...@mail.gmail.com> > > >> > > > > >> "[VOTE] Release Apache Arrow 0.12.0 RC4" on Wed, 16 Jan 2019 > > >> > 12:59:35 > > >> > > > > >> +0100, > > >> > > > > >> Krisztián Szűcs <szucs.kriszt...@gmail.com> wrote: > > >> > > > > >> > > >> > > > > >>> Hi, > > >> > > > > >>> > > >> > > > > >>> I'd like to propose the 2nd voteable release candidate (RC4) > > >> > > > > >>> of > > >> > Apache > > >> > > > > >>> Arrow > > >> > > > > >>> version 0.12.0. This is a major release consisting of 610 > > >> > resolved JIRAs > > >> > > > > >>> [1]. > > >> > > > > >>> > > >> > > > > >>> We've hit several roadblocks during the release. The most > > >> recent > > >> > issues > > >> > > > > >>> were caused by the simultaneous releases of numpy, pandas, > > >> > > > > >>> and > > >> > even the > > >> > > > > >>> great conda-forge compiler migration, which was finished > > >> > yesterday [10]: > > >> > > > > >>> - RC0: the source archive didn't include required files to > > >> build > > >> > > > > >>> gandiva-glib > > >> > > > > >>> documents, also causing failed binary build for Debian > > >> Stretch > > >> > [6]. > > >> > > > > >>> - RC1: compatibility issues with the just released pandas > > >> version > > >> > > > > >> 0.24.rc1 > > >> > > > > >>> [8] > > >> > > > > >>> - RC2: voted, but decided to cut a new one because of faulty > > >> > safe casts > > >> > > > > >> [11] > > >> > > > > >>> - RC3: various conda-forge problems and compatibility with > > >> > pandas 0.22 > > >> > > > > >> [9] > > >> > > > > >>> > > >> > > > > >>> This release candidate is based on commit: > > >> > > > > >>> 8ca41384b5324bfd0ef3d3ed3f728e1d10ed73f0 [2] > > >> > > > > >>> > > >> > > > > >>> The source release rc4 is hosted at [3]. > > >> > > > > >>> The binary artifacts are hosted at [4]. > > >> > > > > >>> The changelog is located at [5]. > > >> > > > > >>> > > >> > > > > >>> Please download, verify checksums and signatures, run the > > >> > > > > >>> unit > > >> > tests, > > >> > > > > >>> and vote on the release. See [7] for how to validate a > > >> > > > > >>> release > > >> > candidate. > > >> > > > > >>> Please use the verification script from the master, because > > >> > > > > >>> it > > >> > has > > >> > > > > >> required > > >> > > > > >>> a patch to work after the recent conda-forge compiler > > >> > > > > >>> migration > > >> > [12]. > > >> > > > > >>> > > >> > > > > >>> The vote will be open for at least 72 hours. > > >> > > > > >>> > > >> > > > > >>> [ ] +1 Release this as Apache Arrow 0.12.0 > > >> > > > > >>> [ ] +0 > > >> > > > > >>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because... > > >> > > > > >>> > > >> > > > > >>> - Krisztian > > >> > > > > >>> > > >> > > > > >>> [1]: > > >> > > > > >>> > > >> > > > > >> > > >> > > > >> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0 > > >> > < > > >> > > > >> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.12.0 > > >> > > > > >> > > > > >>> [2]: > > >> > > > > >>> > > >> > > > > >> > > >> > > > >> https://github.com/apache/arrow/commit/8ca41384b5324bfd0ef3d3ed3f728e1d10ed73f0 > > >> > > > > >>> < > > >> > > > > >> > > >> > > > >> https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359 > > >> > > > > >>> > > >> > > > > >>> [3]: > > >> > > > > >> > > >> > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc4/ > > >> > > > > >>> < > > >> > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/> > > >> > > > > >>> [4]: https://bintray.com/apache/arrow > > >> > > > > >>> <https://bintray.com/beta/#/apache/arrow?tab=packages> > > >> > > > > >>> [5]: > > >> > > > > >>> > > >> > > > > >> > > >> > > > >> https://github.com/apache/arrow/blob/8ca41384b5324bfd0ef3d3ed3f728e1d10ed73f0/CHANGELOG.md > > >> > > > > >>> < > > >> > > > > >> > > >> > > > >> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md > > >> > > > > >>> > > >> > > > > >>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330 > > >> > > > > >>> [7]: > > >> > > > > >>> > > >> > > > > >> > > >> > > > >> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates > > >> > > > > >>> [8]: https://travis-ci.org/kszucs/crossbow/builds/4785586402 > > >> > > > > >>> <https://travis-ci.org/kszucs/crossbow/builds/478558640> > > >> > > > > >>> [9]: https://github.com/apache/arrow/pull/3410 > > >> > > > > >>> [10] https://conda-forge.org/status/ > > >> > > > > >>> [11]: > > >> > > > > >>> > > >> > https://mail-archives.apache.org/mod_mbox/arrow-dev/201901.mbox/browser > > >> > > > > >>> [12]: https://github.com/apache/arrow/pull/3413 > > >> > > > > >> > > >> > > > > > > > >> > > > > > >> > > > >>
