Hi Jacob, Could you share the log of the error to try and understand what is causing the test failures?
El jue, 27 abr 2023, 0:29, Jacob Wujciak <ja...@voltrondata.com.invalid> escribió: > I was able to build with USE_CONDA=1 but that produced a long list of test > failures, which seems concerning? > 17 - arrow-compute-internals-test (Failed) > 18 - arrow-compute-expression-test (Failed) > 19 - arrow-compute-scalar-cast-test (Failed) > 20 - arrow-compute-scalar-type-test (Failed) > 21 - arrow-compute-scalar-if-else-test (Failed) > 22 - arrow-compute-scalar-temporal-test (Failed) > 23 - arrow-compute-scalar-math-test (Failed) > 24 - arrow-compute-scalar-utility-test (Failed) > 25 - arrow-compute-vector-test (Failed) > 26 - arrow-compute-aggregate-test (Failed) > 27 - arrow-compute-kernel-utility-test (Failed) > 28 - arrow-io-buffered-test (Failed) > 29 - arrow-io-compressed-test (Failed) > 30 - arrow-io-file-test (Failed) > 33 - arrow-utility-test (Failed) > 34 - arrow-async-utility-test (Failed) > 41 - arrow-acero-order-by-node-test (Failed) > 42 - arrow-acero-hash-join-node-test (Failed) > 50 - arrow-cuda-test (Failed) > 51 - arrow-dataset-dataset-test (Failed) > 59 - arrow-dataset-file-csv-test (Failed) > 60 - arrow-dataset-file-json-test (Failed) > 65 - arrow-flight-internals-test (Failed) > 66 - arrow-flight-test (Failed) > 67 - arrow-flight-sql-test (Failed) > 68 - arrow-flight-integration-test (Failed) > 70 - arrow-ipc-json-simple-test (Failed) > 71 - arrow-ipc-read-write-test (Failed) > 72 - arrow-ipc-tensor-test (Failed) > 74 - arrow-fixed-shape-tensor-test (Failed) > 77 - parquet-reader-test (Failed) > 78 - parquet-writer-test (Failed) > 79 - parquet-arrow-test (Failed) > 80 - parquet-arrow-internals-test (Failed) > 83 - parquet-file-deserialize-test (Failed) > 84 - parquet-schema-test (Failed) > 85 - gandiva-internals-test (Failed) > 87 - gandiva-filter-test (Failed) > 88 - gandiva-projector-test (Failed) > 93 - gandiva-binary-test (Failed) > 94 - gandiva-date-time-test (Failed) > 95 - gandiva-to-string-test (Failed) > 99 - gandiva-null-validity-test (Failed) > > ARROW_GANDIVA=0 and non conda worked fine though. > > On Tue, Apr 25, 2023 at 11:50 PM Jacob Wujciak <ja...@voltrondata.com> > wrote: > > > I checked out a trace for the cmake issue and LLVM 15.07 is found > > correctly. The issue come from `llvm_map_components_to_libnames` which > > complains about X86 not being in the lsit of libraries. But we don't add > > that but rather it gets appended in the function? > > > > /usr/lib/cmake/llvm/LLVM-Config.cmake(228): > > get_property(LLVM_TARGETS_CONFIGURED GLOBAL PROPERTY > > LLVM_TARGETS_CONFIGURED ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(234): if(NOT > > LLVM_TARGETS_CONFIGURED ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(244): list(FIND > > LLVM_TARGETS_TO_BUILD X86 have_native_backend ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(245): list(FIND link_components > > engine engine_required ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(246): if(NOT engine_required EQUAL > > -1 ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(255): list(FIND link_components > > native native_required ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(256): if(NOT native_required EQUAL > > -1 ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(257): if(NOT have_native_backend > > EQUAL -1 ) > > */usr/lib/cmake/llvm/LLVM-Config.cmake(258): list(APPEND link_components > > X86 )* > > /usr/lib/cmake/llvm/LLVM-Config.cmake(263): > > llvm_expand_pseudo_components(link_components > > > core;mcjit;native;ipo;bitreader;target;linker;analysis;debuginfodwarf;X86 ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(127): set(link_components > > > core;mcjit;native;ipo;bitreader;target;linker;analysis;debuginfodwarf;X86 ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(128): foreach(c > > > core;mcjit;native;ipo;bitreader;target;linker;analysis;debuginfodwarf;X86 ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(130): list(FIND > > LLVM_TARGETS_TO_BUILD core idx ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(131): if(NOT idx LESS 0 ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(159): elseif(c STREQUAL > > nativecodegen ) > > [snip] > > /usr/lib/cmake/llvm/LLVM-Config.cmake(212): list(APPEND > > expanded_components debuginfodwarf ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(130): list(FIND > > LLVM_TARGETS_TO_BUILD X86 idx ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(131): if(NOT idx LESS 0 ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(132): if(TARGET LLVMX86CodeGen ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(134): else() > > /usr/lib/cmake/llvm/LLVM-Config.cmake(135): if(TARGET LLVMX86 ) > > /usr/lib/cmake/llvm/LLVM-Config.cmake(137): else() > > */usr/lib/cmake/llvm/LLVM-Config.cmake(138): message(FATAL_ERROR Target > > X86 is not in the set of libraries. )* > > > > On Tue, Apr 25, 2023 at 10:57 AM Raúl Cumplido <raulcumpl...@gmail.com> > > wrote: > > > >> I have created the following issue for the new wheels test failure > >> around pandas 2.0.1 : https://github.com/apache/arrow/issues/35321 > >> > >> I don't think we should create a new RC for that issue but I'm happy > >> to know other people's thoughts around that. > >> > >> El lun, 24 abr 2023 a las 21:12, Raúl Cumplido > >> (<raulcumpl...@gmail.com>) escribió: > >> > > >> > El lun, 24 abr 2023 a las 18:53, Will Jones > >> > (<will.jones...@gmail.com>) escribió: > >> > > > >> > > I'm seeing failing Pandas tests in PyArrow when verifying with > >> > > > >> > > USE_CONDA=1 dev/release/verify-release-candidate.sh 12.0.0 0 > >> > > > >> > > > >> > pyarrow/tests/test_extension_type.py::test_extension_to_pandas_storage_type[registered_period_type0] > >> > > - NotImplementedError: extension<test.period<PeriodType>> > >> > > >> > This is also happening on our nightlies from today: > >> > > >> > https://github.com/ursacomputing/crossbow/actions/runs/4786502455/jobs/8510514881 > >> > > >> > There has been a new pandas release: 2.0.1 around 9 hours ago which > >> > seems to be the causing issue: > >> > https://pypi.org/project/pandas/#history > >> > > >> > > > >> > > No one else is getting that? > >> > > > >> > > > >> > > On Sun, Apr 23, 2023 at 9:21 AM Raúl Cumplido < > raulcumpl...@gmail.com > >> > > >> > > wrote: > >> > > > >> > > > +1 (non binding) > >> > > > > >> > > > I have tested both SOURCES and BINARIES successfully with: > >> > > > TEST_DEFAULT=0 TEST_SOURCE=1 > dev/release/verify-release-candidate.sh > >> > > > 12.0.0 0 > >> > > > TEST_DEFAULT=0 TEST_WHEELS=1 > dev/release/verify-release-candidate.sh > >> > > > 12.0.0 0 > >> > > > TEST_DEFAULT=0 TEST_BINARIES=1 > >> dev/release/verify-release-candidate.sh > >> > > > 12.0.0 0 > >> > > > with: > >> > > > * Python 3.10.6 > >> > > > * gcc (Ubuntu 11.3.0-1ubuntu1~22.04) 11.3.0 > >> > > > * NVIDIA CUDA cuda_11.5.r11.5/compiler.30672275_0 > >> > > > * openjdk version "17.0.6" 2023-01-17 > >> > > > * ruby 3.0.2p107 (2021-07-07 revision 0db68f0233) > >> [x86_64-linux-gnu] > >> > > > * dotnet 7.0.203 > >> > > > * Ubuntu 22.04 LTS > >> > > > > >> > > > El dom, 23 abr 2023 a las 12:59, Yibo Cai (<yibo....@arm.com>) > >> escribió: > >> > > > > > >> > > > > +1 > >> > > > > > >> > > > > I ran the followings on Ubuntu-22.04, aarch64. > >> > > > > > >> > > > > TEST_DEFAULT=0 \ > >> > > > > TEST_CPP=1 \ > >> > > > > TEST_PYTHON=1 \ > >> > > > > TEST_GO=1 \ > >> > > > > dev/release/verify-release-candidate.sh 12.0.0 0 > >> > > > > > >> > > > > TEST_DEFAULT=0 \ > >> > > > > TEST_WHEELS=1 \ > >> > > > > dev/release/verify-release-candidate.sh 12.0.0 0 > >> > > > > > >> > > > > > >> > > > > On 4/23/23 14:40, Sutou Kouhei wrote: > >> > > > > > +1 > >> > > > > > > >> > > > > > I ran the followings on Debian GNU/Linux sid: > >> > > > > > > >> > > > > > * TEST_DEFAULT=0 \ > >> > > > > > TEST_SOURCE=1 \ > >> > > > > > LANG=C \ > >> > > > > > TZ=UTC \ > >> > > > > > CUDAToolkit_ROOT=/usr \ > >> > > > > > ARROW_CMAKE_OPTIONS="-DBoost_NO_BOOST_CMAKE=ON > >> > > > -Dxsimd_SOURCE=BUNDLED" \ > >> > > > > > dev/release/verify-release-candidate.sh 12.0.0 0 > >> > > > > > > >> > > > > > * TEST_DEFAULT=0 \ > >> > > > > > TEST_APT=1 \ > >> > > > > > LANG=C \ > >> > > > > > dev/release/verify-release-candidate.sh 12.0.0 0 > >> > > > > > > >> > > > > > * TEST_DEFAULT=0 \ > >> > > > > > TEST_BINARY=1 \ > >> > > > > > LANG=C \ > >> > > > > > dev/release/verify-release-candidate.sh 12.0.0 0 > >> > > > > > > >> > > > > > * TEST_DEFAULT=0 \ > >> > > > > > TEST_JARS=1 \ > >> > > > > > LANG=C \ > >> > > > > > dev/release/verify-release-candidate.sh 12.0.0 0 > >> > > > > > > >> > > > > > * TEST_DEFAULT=0 \ > >> > > > > > TEST_PYTHON_VERSIONS=3.11 \ > >> > > > > > TEST_WHEELS=1 \ > >> > > > > > LANG=C \ > >> > > > > > dev/release/verify-release-candidate.sh 12.0.0 0 > >> > > > > > > >> > > > > > * TEST_DEFAULT=0 \ > >> > > > > > TEST_YUM=1 \ > >> > > > > > LANG=C \ > >> > > > > > dev/release/verify-release-candidate.sh 12.0.0 0 > >> > > > > > > >> > > > > > with: > >> > > > > > > >> > > > > > * .NET SDK (6.0.406) > >> > > > > > * Python 3.11.2 > >> > > > > > * gcc (Debian 12.2.0-14) 12.2.0 > >> > > > > > * nvidia-cuda-dev 11.7.99~11.7.1-4 > >> > > > > > * openjdk version "17.0.6" 2023-01-17 > >> > > > > > * ruby 3.1.2p20 (2022-04-12 revision 4491bb740a) > >> [x86_64-linux-gnu] > >> > > > > > > >> > > > > > > >> > > > > > Thanks, > >> > > > > >> > > >
