@David -- the macOS conda-based build is a bit finicky due to the SDK-related issues. In any case since we can successfully produce macOS binaries for Homebrew and wheel/conda, that's the most important thing, though we should aim for a more refined out-of-the-box development experience
Not sure if https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst contains any helpful environment configuration related information On Fri, Sep 27, 2019 at 9:56 AM Micah Kornfield <emkornfi...@gmail.com> wrote: > > > > > I checked in the key to https://dist.apache.org/repos/dist/release/arrow/. > > Is there something else I need to do to make it available for verification? > > To answer my own question I think I missed adding them to the the dev > branch (I just did this so hopefully they will propagate soon). > > On Fri, Sep 27, 2019 at 8:46 AM Micah Kornfield <emkornfi...@gmail.com> > wrote: > > > I found that Micah's GPG key did not seem to be in KEYS and had to > >> import it manually. > > > > > > I checked in the key to https://dist.apache.org/repos/dist/release/arrow/. > > Is there something else I need to do to make it available for verification? > > > > On Fri, Sep 27, 2019 at 7:45 AM Andy Grove <andygrov...@gmail.com> wrote: > > > >> +1 for Rust implementation. Tests run fine out the box. Version numbers > >> are correct. > >> > >> On Fri, Sep 27, 2019 at 7:26 AM David Li <li.david...@gmail.com> wrote: > >> > >>> I ran the source verification script on MacOS 10.12 (Sierra). > >>> > >>> I found that Micah's GPG key did not seem to be in KEYS and had to > >>> import it manually. > >>> > >>> Python failed in pyarrow/tests/test_cython.py::test_cython_api when > >>> invoking gcc. Is this the MacOS conda toolchain issue? It works if I > >>> add `-stdlib=libc++` to the compiler options > >>> (https://stackoverflow.com/questions/40301619) > >>> > >>> Compiling pyarrow_cython_example.pyx because it changed. > >>> [1/1] Cythonizing pyarrow_cython_example.pyx > >>> Extension module: > >>> <distutils.extension.Extension('pyarrow_cython_example') at > >>> 0x112c40390> > >>> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include', > >>> > >>> '/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include'] > >>> ['arrow', 'arrow_python'] > >>> > >>> ['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow', > >>> > >>> '/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib'] > >>> running build_ext > >>> building 'pyarrow_cython_example' extension > >>> creating build > >>> creating build/temp.macosx-10.7-x86_64-3.6 > >>> gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g > >>> -fwrapv -O3 -Wall -Wstrict-prototypes > >>> > >>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include > >>> -arch x86_64 > >>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include > >>> -arch x86_64 > >>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include > >>> > >>> -I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include > >>> > >>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m > >>> -c pyarrow_cython_example.cpp -o > >>> build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o -std=c++11 > >>> > >>> pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map' file not > >>> found > >>> #include <unordered_map> > >>> ^~~~~~~~~~~~~~~ > >>> 1 error generated. > >>> error: command 'gcc' failed with exit status 1 > >>> > >>> > >>> It also failed in all the tests in > >>> pyarrow/tests/test_plasma.py::TestPlasmaClient: > >>> > >>> WARNING: Logging before InitGoogleLogging() is written to STDERR > >>> I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the Plasma > >>> store to use up to 0.1GB of memory. > >>> I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object store > >>> with directory /tmp and huge page support disabled > >>> E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is too long. > >>> F0927 08:54:13.049515 2902139840 store.cc:1074] Check failed: socket >= > >>> 0 > >>> *** Check failure stack trace: *** > >>> *** Aborted at 1569588853 (unix time) try "date -d @1569588853" if you > >>> are using GNU date *** > >>> PC: @ 0x0 (unknown) > >>> *** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID > >>> 0x7fffacfb23c0) stack trace: *** > >>> @ 0x7fffa42a8b3a _sigtramp > >>> > >>> For this latter issue, I believe we ran into this with Flight last > >>> release. MacOS generates very long temporary directory paths, and this > >>> usually exceeds the limit on domain socket path lengths. (I also can't > >>> get mktemp to respect TMPDIR.) > >>> > >>> Best, > >>> David > >>> > >>> > >>> On 9/27/19, Micah Kornfield <emkornfi...@gmail.com> wrote: > >>> > Hi, > >>> > > >>> > > >>> > I would like to propose the following release candidate (RC1) of Apache > >>> > > >>> > Arrow version 0.15.0. This is a release consisting of 672 > >>> > > >>> > resolved JIRA issues[1]. (RC0 was aborted due to release script > >>> issues). > >>> > > >>> > > >>> > This release candidate is based on commit: > >>> > > >>> > 77f091888dbe5a4e023a66b986a2dd474696061a [2] > >>> > > >>> > > >>> > The source release rc1 is hosted at [3]. > >>> > > >>> > The binary artifacts are hosted at [4][5][6][7]. > >>> > > >>> > The changelog is located at [8]. > >>> > > >>> > > >>> > Please download, verify checksums and signatures, run the unit tests, > >>> > > >>> > and vote on the release. See [9] for how to validate a release > >>> candidate. > >>> > > >>> > > >>> > The vote will be open for at least 72 hours. > >>> > > >>> > > >>> > [ ] +1 Release this as Apache Arrow 0.15.0 > >>> > > >>> > [ ] +0 > >>> > > >>> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because... > >>> > > >>> > > >>> > [1]: > >>> > > >>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0 > >>> > > >>> > [2]: > >>> > > >>> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a > >>> > > >>> > [3]: > >>> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1 > >>> > > >>> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1 > >>> > > >>> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1 > >>> > > >>> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1 > >>> > > >>> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1 > >>> > > >>> > [8]: > >>> > > >>> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md > >>> > > >>> > [9]: > >>> > > >>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates > >>> > > >>> > >>
