I updated the code documentation manually http://arrow.apache.org/docs/ http://arrow.apache.org/docs/c_glib/ http://arrow.apache.org/docs/java/
I opened a JIRA about fixing the Docker build On Sun, Jan 20, 2019 at 5:37 PM Wes McKinney <wesmck...@gmail.com> wrote: > > I just posted a PR with a blog post and website updates > > https://github.com/apache/arrow/pull/3440 > > I'd like to publish this around 15:00 UTC tomorrow (Monday, January > 21) so if you would like to add or change anything please push to the > PR or leave a commit hash for me to cherry pick > > I'm going to update the documentation manually on my laptop -- I think > the Dockerfile is out of date now, and we now have a CUDA dependency > for the Python part of the docs. > > On Sun, Jan 20, 2019 at 4:02 PM Krisztián Szűcs > <szucs.kriszt...@gmail.com> wrote: > > > > Python wheels and Java maven artifacts are uploaded. > > > > On Sun, Jan 20, 2019 at 3:27 AM Wes McKinney <wesmck...@gmail.com> wrote: > > > > > By the way -- I think we should probably keep 2-5 past releases in the > > > dist system so we avoid breaking packaging builds that are depending > > > on the mirror system. This already caused an issue resulting in Arrow > > > being removed from Homebrew > > > (https://issues.apache.org/jira/browse/ARROW-4300), though the root > > > cause of that was that the recipe was not being properly maintained by > > > the Arrow community. > > > > > > On Sat, Jan 19, 2019 at 7:39 PM Wes McKinney <wesmck...@gmail.com> wrote: > > > > > > > > Who can take care of updating the documentation? It needs to be built > > > > on a machine with CUDA so I can do it if no one else is available. The > > > > website and publishing workflow will need to be slightly updated so > > > > that the top-level docs are published to arrow.apache.org/docs instead > > > > of arrow.apache.org/python as it is now > > > > > > > > On Sat, Jan 19, 2019 at 3:08 PM Kouhei Sutou <k...@clear-code.com> > > > > wrote: > > > > > > > > > > Hi, > > > > > > > > > > I've published all Ruby packages. > > > > > > > > > > Thanks, > > > > > -- > > > > > kou > > > > > > > > > > In <CAJEf=x5sphovpj4itlm949hwczxwr47g0hzzsnfvsjxgdjr...@mail.gmail.com > > > > > > > > > "Re: [RESULT] [VOTE] Release Apache Arrow 0.12.0 RC4" on Sat, 19 Jan > > > 2019 13:45:12 -0700, > > > > > Andy Grove <andygrov...@gmail.com> wrote: > > > > > > > > > > > I've published the Arrow crate (Rust) to crates.io > > > > > > > > > > > > https://crates.io/crates/arrow > > > > > > > > > > > > Chao will need to now publish the parquet crate. > > > > > > > > > > > > I will start a separate thread about adding other owners to > > > crates.io for > > > > > > these crates. > > > > > > > > > > > > Thanks, > > > > > > > > > > > > Andy. > > > > > > > > > > > > On Sat, Jan 19, 2019 at 12:23 PM Krisztián Szűcs < > > > szucs.kriszt...@gmail.com> > > > > > > wrote: > > > > > > > > > > > >> I've uploaded the source archive to SVN and the binaries to > > > > > >> bintray. > > > > > >> > > > > > >> On Sat, Jan 19, 2019 at 5:33 PM Uwe L. Korn <m...@uwekorn.com> > > > wrote: > > > > > >> > > > > > >> > I can help with the conda-forge packages. > > > > > >> > > > > > > >> > Uwe > > > > > >> > > > > > > >> > On Sat, Jan 19, 2019, at 5:21 PM, Wes McKinney wrote: > > > > > >> > > The vote carries with 3 binding +1 votes. Thanks to everyone > > > > > >> > > for > > > > > >> > > helping verify the release > > > > > >> > > > > > > > >> > > There are a number of post-release tasks in > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide > > > > > >> > > > > > > > >> > > I will rebase the master branch right now. I can draft a blog > > > post > > > > > >> > > announcing the release to be sent out on Monday. Who can help > > > with the > > > > > >> > > other items? > > > > > >> > > > > > > > >> > > Thank you > > > > > >> > > Wes > > > > > >> > > > > > > > >> > > On Fri, Jan 18, 2019 at 5:48 PM Andrew Palumbo < > > > ap....@outlook.com> > > > > > >> > wrote: > > > > > >> > > > > > > > > >> > > > My mistake I missed the note about using the verify script > > > from > > > > > >> master. > > > > > >> > > > > > > > > >> > > > On Jan 18, 2019 3:38 PM, Andrew Palumbo <ap....@outlook.com> > > > wrote: > > > > > >> > > > I seem have been failing here: > > > > > >> > > > > > > > > >> > > > ../../../release/libgandiva.so.12.0.0: undefined reference to > > > > > >> > `llvm::sys::DynamicLibrary::getPermanentLibrary(char const*, > > > > > >> std::string*)' > > > > > >> > > > collect2: error: ld returned 1 exit status > > > > > >> > > > > > > > > >> > > > src/gandiva/tests/CMakeFiles/gandiva-date_time_test.dir/build.make:94: > > > > > >> > recipe for target 'release/gandiva-date_time_test' failed > > > > > >> > > > make[2]: *** [release/gandiva-date_time_test] Error 1 > > > > > >> > > > CMakeFiles/Makefile2:8836: recipe for target > > > > > >> > 'src/gandiva/tests/CMakeFiles/gandiva-date_time_test.dir/all' > > > failed > > > > > >> > > > make[1]: *** > > > > > >> > [src/gandiva/tests/CMakeFiles/gandiva-date_time_test.dir/all] > > > Error 2 > > > > > >> > > > [ 63%] Linking CXX executable > > > ../../../release/gandiva-projector_test > > > > > >> > > > ../../../release/libgandiva.so.12.0.0: undefined reference to > > > > > >> > `llvm::sys::DynamicLibrary::getPermanentLibrary(char const*, > > > > > >> std::string*)' > > > > > >> > > > collect2: error: ld returned 1 exit status > > > > > >> > > > > > > > > >> > > > src/gandiva/tests/CMakeFiles/gandiva-projector_test.dir/build.make:94: > > > > > >> > recipe for target 'release/gandiva-projector_test' failed > > > > > >> > > > make[2]: *** [release/gandiva-projector_test] Error 1 > > > > > >> > > > CMakeFiles/Makefile2:8627: recipe for target > > > > > >> > 'src/gandiva/tests/CMakeFiles/gandiva-projector_test.dir/all' > > > failed > > > > > >> > > > make[1]: *** > > > > > >> > [src/gandiva/tests/CMakeFiles/gandiva-projector_test.dir/all] > > > Error 2 > > > > > >> > > > [ 63%] Linking CXX executable > > > > > >> > ../../../release/gandiva-projector_test_static > > > > > >> > > > ../../../release/libgandiva.a(engine.cc.o): In function > > > > > >> > `gandiva::Engine::InitOnce()': > > > > > >> > > > engine.cc:(.text+0x537): undefined reference to > > > > > >> > `llvm::sys::DynamicLibrary::getPermanentLibrary(char const*, > > > > > >> std::string*)' > > > > > >> > > > collect2: error: ld returned 1 exit status > > > > > >> > > > > > > > > >> > > > > > > >> > > > src/gandiva/tests/CMakeFiles/gandiva-projector_test_static.dir/build.make:147: > > > > > >> > recipe for target 'release/gandiva-projector_test_static' failed > > > > > >> > > > make[2]: *** [release/gandiva-projector_test_static] Error 1 > > > > > >> > > > CMakeFiles/Makefile2:8756: recipe for target > > > > > >> > > > > 'src/gandiva/tests/CMakeFiles/gandiva-projector_test_static.dir/all' > > > > > >> failed > > > > > >> > > > make[1]: *** > > > > > >> > > > > [src/gandiva/tests/CMakeFiles/gandiva-projector_test_static.dir/all] > > > > > >> Error 2 > > > > > >> > > > Makefile:140: recipe for target 'all' failed > > > > > >> > > > make: *** [all] Error 2 > > > > > >> > > > + cleanup > > > > > >> > > > + rm -fr /tmp/arrow-0.12.0.mC5MI > > > > > >> > > > > > > > > >> > > > running: > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > dev/release/verify-release-candidate.sh source 0.12.0 4 > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > might want to take with a grain of salt, my system may not be > > > > > >> > configured correctly. Are there any new dependencies necessary > > > since > > > > > >> RC2? > > > > > >> > > > > > > > > >> > > > --andy > > > > > >> > > > ________________________________ > > > > > >> > > > From: Wes McKinney <wesmck...@gmail.com> > > > > > >> > > > Sent: Thursday, January 17, 2019 5:51 PM > > > > > >> > > > To: dev@arrow.apache.org > > > > > >> > > > Subject: Re: [VOTE] Release Apache Arrow 0.12.0 RC4 > > > > > >> > > > > > > > > >> > > > +1 (binding) > > > > > >> > > > > > > > > >> > > > * Ran verification script with Ubuntu 14.04, JDK8, Node 11.6 > > > > > >> > > > (installed with nvm, which I guess sets up npx), gcc 4.8 > > > > > >> > > > * Ran verification script on Windows 10 / MSVC 2015 with a > > > minor > > > > > >> > > > change to turn on the unit tests > > > > > >> > > > > > > > > >> > > > > > > >> > > > https://github.com/apache/arrow/commit/0f8bd747468dd28c909ef823bed77d8082a5b373 > > > > > >> > > > > > > > > >> > > > Thanks to Krisztian and everyone else for the help on this > > > release > > > > > >> > > > > > > > > >> > > > On Thu, Jan 17, 2019 at 11:59 AM Antoine Pitrou < > > > anto...@python.org> > > > > > >> > wrote: > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > +1 (binding) > > > > > >> > > > > > > > > > >> > > > > I ran "./dev/release/verify-release-candidate.sh source > > > 0.12.0 4". > > > > > >> > > > > Everything succeeded before JS, which failed > > > > > >> > > > > ("./dev/release/verify-release-candidate.sh: ligne 258: npx > > > : > > > > > >> > commande > > > > > >> > > > > introuvable"). > > > > > >> > > > > > > > > > >> > > > > - Ubuntu 18.04.1 (x86-64) > > > > > >> > > > > - CUDA enabled > > > > > >> > > > > - gcc 7.3.0 > > > > > >> > > > > - java version "1.8.0_201" > > > > > >> > > > > Java(TM) SE Runtime Environment (build 1.8.0_201-b09) > > > > > >> > > > > Java HotSpot(TM) 64-Bit Server VM (build 25.201-b09, mixed > > > mode) > > > > > >> > > > > > > > > > >> > > > > Regards > > > > > >> > > > > > > > > > >> > > > > Antoine. > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > Le 17/01/2019 à 18:03, Bryan Cutler a écrit : > > > > > >> > > > > > +1 > > > > > >> > > > > > > > > > > >> > > > > > I ran ARROW_HAVE_CUDA=NO > > > dev/release/verify-release-candidate.sh > > > > > >> > source > > > > > >> > > > > > 0.12.0 4 > > > > > >> > > > > > > > > > > >> > > > > > - 4.15.0-43-generic #46~16.04.1-Ubuntu > > > > > >> > > > > > - openjdk version "1.8.0_191" > > > > > >> > > > > > - gcc version 5.4.0 > > > > > >> > > > > > > > > > > >> > > > > > I also ran Spark integration tests and was able to get > > > all tests > > > > > >> > passing > > > > > >> > > > > > after some minor modifications. > > > > > >> > > > > > > > > > > >> > > > > > Bryan > > > > > >> > > > > > > > > > > >> > > > > > On Thu, Jan 17, 2019 at 12:48 AM Kouhei Sutou < > > > > > >> k...@clear-code.com> > > > > > >> > wrote: > > > > > >> > > > > > > > > > > >> > > > > >> +1 (binding) > > > > > >> > > > > >> > > > > > >> > > > > >> I ran the followings on Debian GNU/Linux sid: > > > > > >> > > > > >> > > > > > >> > > > > >> * CC=gcc-7 CXX=g++-7 > > > dev/release/verify-release-candidate.sh > > > > > >> > source > > > > > >> > > > > >> 0.12.0 4 > > > > > >> > > > > >> * dev/release/verify-release-candidate.sh binaries > > > 0.12.0 4 > > > > > >> > > > > >> > > > > > >> > > > > >> with: > > > > > >> > > > > >> > > > > > >> > > > > >> * gcc-7 (Debian 7.4.0-2) 7.4.0 > > > > > >> > > > > >> * openjdk version "1.8.0_191" > > > > > >> > > > > >> * ruby 2.7.0dev (2019-01-17 trunk 66841) > > > > > >> > > > > >> [x86_64-linux] > > > > > >> > > > > >> * nvidia-cuda-dev 9.2.148-5 > > > > > >> > > > > >> > > > > > >> > > > > >> I couldn't run JavaScript tests and integration tests > > > with > > > > > >> > > > > >> JavaScript because I couldn't prepare workable Node.js > > > 11. > > > > > >> > > > > >> (I can prepare workable Node.js 10.15.) > > > > > >> > > > > >> > > > > > >> > > > > >> RC4 includes JavaScript update > > > > > >> > > > > >> > > > > > >> > > > > >> > > > > > >> > > > > > > >> > > > https://github.com/apache/arrow/commit/5598d2f42573ed19e7db4aae7adb02af2cd4ccd0 > > > > > >> > > > > >> . It requires Node.js 11. > > > > > >> > > > > >> > > > > > >> > > > > >> I think that JavaScript implementation isn't important > > > > > >> > > > > >> in > > > > > >> > > > > >> this release. Because we still release JavaScript > > > > > >> > > > > >> implementation separately. > > > > > >> > > > > >> > > > > > >> > > > > >> I hope that 0.13.0 release includes JavaScript > > > > > >> > > > > >> implementation. > > > > > >> > > > > >> > > > > > >> > > > > >> > > > > > >> > > > > >> Thanks, > > > > > >> > > > > >> -- > > > > > >> > > > > >> kou > > > > > >> > > > > >> > > > > > >> > > > > >> In < > > > > > >> > > > > cahm19a46rwdzozw_htfqjhcoj6ou2nyj1ms_90-j4eru5jz...@mail.gmail.com> > > > > > >> > > > > >> "[VOTE] Release Apache Arrow 0.12.0 RC4" on Wed, 16 > > > Jan 2019 > > > > > >> > 12:59:35 > > > > > >> > > > > >> +0100, > > > > > >> > > > > >> Krisztián Szűcs <szucs.kriszt...@gmail.com> wrote: > > > > > >> > > > > >> > > > > > >> > > > > >>> Hi, > > > > > >> > > > > >>> > > > > > >> > > > > >>> I'd like to propose the 2nd voteable release candidate > > > (RC4) of > > > > > >> > Apache > > > > > >> > > > > >>> Arrow > > > > > >> > > > > >>> version 0.12.0. This is a major release consisting of > > > 610 > > > > > >> > resolved JIRAs > > > > > >> > > > > >>> [1]. > > > > > >> > > > > >>> > > > > > >> > > > > >>> We've hit several roadblocks during the release. The > > > most > > > > > >> recent > > > > > >> > issues > > > > > >> > > > > >>> were caused by the simultaneous releases of numpy, > > > pandas, and > > > > > >> > even the > > > > > >> > > > > >>> great conda-forge compiler migration, which was > > > > > >> > > > > >>> finished > > > > > >> > yesterday [10]: > > > > > >> > > > > >>> - RC0: the source archive didn't include required files > > > to > > > > > >> build > > > > > >> > > > > >>> gandiva-glib > > > > > >> > > > > >>> documents, also causing failed binary build for > > > > > >> > > > > >>> Debian > > > > > >> Stretch > > > > > >> > [6]. > > > > > >> > > > > >>> - RC1: compatibility issues with the just released > > > pandas > > > > > >> version > > > > > >> > > > > >> 0.24.rc1 > > > > > >> > > > > >>> [8] > > > > > >> > > > > >>> - RC2: voted, but decided to cut a new one because of > > > faulty > > > > > >> > safe casts > > > > > >> > > > > >> [11] > > > > > >> > > > > >>> - RC3: various conda-forge problems and compatibility > > > with > > > > > >> > pandas 0.22 > > > > > >> > > > > >> [9] > > > > > >> > > > > >>> > > > > > >> > > > > >>> This release candidate is based on commit: > > > > > >> > > > > >>> 8ca41384b5324bfd0ef3d3ed3f728e1d10ed73f0 [2] > > > > > >> > > > > >>> > > > > > >> > > > > >>> The source release rc4 is hosted at [3]. > > > > > >> > > > > >>> The binary artifacts are hosted at [4]. > > > > > >> > > > > >>> The changelog is located at [5]. > > > > > >> > > > > >>> > > > > > >> > > > > >>> Please download, verify checksums and signatures, run > > > the unit > > > > > >> > tests, > > > > > >> > > > > >>> and vote on the release. See [7] for how to validate a > > > release > > > > > >> > candidate. > > > > > >> > > > > >>> Please use the verification script from the master, > > > because it > > > > > >> > has > > > > > >> > > > > >> required > > > > > >> > > > > >>> a patch to work after the recent conda-forge compiler > > > migration > > > > > >> > [12]. > > > > > >> > > > > >>> > > > > > >> > > > > >>> The vote will be open for at least 72 hours. > > > > > >> > > > > >>> > > > > > >> > > > > >>> [ ] +1 Release this as Apache Arrow 0.12.0 > > > > > >> > > > > >>> [ ] +0 > > > > > >> > > > > >>> [ ] -1 Do not release this as Apache Arrow 0.12.0 > > > because... > > > > > >> > > > > >>> > > > > > >> > > > > >>> - Krisztian > > > > > >> > > > > >>> > > > > > >> > > > > >>> [1]: > > > > > >> > > > > >>> > > > > > >> > > > > >> > > > > > >> > > > > > > >> > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0 > > > > > >> > < > > > > > >> > > > > > > >> > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.12.0 > > > > > >> > > > > > > > >> > > > > >>> [2]: > > > > > >> > > > > >>> > > > > > >> > > > > >> > > > > > >> > > > > > > >> > > > https://github.com/apache/arrow/commit/8ca41384b5324bfd0ef3d3ed3f728e1d10ed73f0 > > > > > >> > > > > >>> < > > > > > >> > > > > >> > > > > > >> > > > > > > >> > > > https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359 > > > > > >> > > > > >>> > > > > > >> > > > > >>> [3]: > > > > > >> > > > > >> > > > > > >> > > > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc4/ > > > > > >> > > > > >>> < > > > > > >> > > > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/> > > > > > >> > > > > >>> [4]: https://bintray.com/apache/arrow > > > > > >> > > > > >>> <https://bintray.com/beta/#/apache/arrow?tab=packages> > > > > > >> > > > > >>> [5]: > > > > > >> > > > > >>> > > > > > >> > > > > >> > > > > > >> > > > > > > >> > > > https://github.com/apache/arrow/blob/8ca41384b5324bfd0ef3d3ed3f728e1d10ed73f0/CHANGELOG.md > > > > > >> > > > > >>> < > > > > > >> > > > > >> > > > > > >> > > > > > > >> > > > https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md > > > > > >> > > > > >>> > > > > > >> > > > > >>> [6]: > > > https://travis-ci.org/kszucs/crossbow/builds/478393330 > > > > > >> > > > > >>> [7]: > > > > > >> > > > > >>> > > > > > >> > > > > >> > > > > > >> > > > > > > >> > > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates > > > > > >> > > > > >>> [8]: > > > https://travis-ci.org/kszucs/crossbow/builds/4785586402 > > > > > >> > > > > >>> <https://travis-ci.org/kszucs/crossbow/builds/478558640 > > > > > > > > > >> > > > > >>> [9]: https://github.com/apache/arrow/pull/3410 > > > > > >> > > > > >>> [10] https://conda-forge.org/status/ > > > > > >> > > > > >>> [11]: > > > > > >> > > > > >>> > > > > > >> > > > > https://mail-archives.apache.org/mod_mbox/arrow-dev/201901.mbox/browser > > > > > >> > > > > >>> [12]: https://github.com/apache/arrow/pull/3413 > > > > > >> > > > > >> > > > > > >> > > > > > > > > > > >> > > > > > > > > >> > > > > > > >> > > >
