[
https://issues.apache.org/jira/browse/ARROW-11075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270419#comment-17270419
]
Uwe Korn commented on ARROW-11075:
----------------------------------
The latest ORC release is supporting shared linkage and the conda toolchain has
been reworked to link dynamically:
https://github.com/conda-forge/arrow-cpp-feedstock/blob/1.0.x/recipe/meta.yaml.
The major issue here is probably that ORC 0.6.2 is built as part of the Arrow
thirdparty toolchain but 0.6.6 headers are used during the build. Not sure how
this links but that feels like the most likely issue to me.
> [Python] Getting reference not found with OCR enabled pyarrow
> -------------------------------------------------------------
>
> Key: ARROW-11075
> URL: https://issues.apache.org/jira/browse/ARROW-11075
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Affects Versions: 1.0.1
> Environment: PPC64LE
> Reporter: Kandarpa
> Priority: Major
> Attachments: arrow_cpp_build.log, arrow_python_build.log,
> conda_list.txt
>
>
> Generated the pyarrow with OCR enabled on Power using following steps:
> {code:java}
> export ARROW_HOME=$CONDA_PREFIX
> mkdir cpp/build
> cd cpp/build
> cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
> -DCMAKE_INSTALL_LIBDIR=lib \
> -DARROW_WITH_BZ2=ON \
> -DARROW_WITH_ZLIB=ON \
> -DARROW_WITH_ZSTD=ON \
> -DARROW_WITH_LZ4=ON \
> -DARROW_WITH_SNAPPY=ON \
> -DARROW_WITH_BROTLI=ON \
> -DARROW_PARQUET=ON \
> -DARROW_PYTHON=ON \
> -DARROW_BUILD_TESTS=ON \
> -DARROW_CUDA=ON \
> -DCUDA_CUDA_LIBRARY=/usr/local/cuda/lib64/stubs/libcuda.so \
> -DARROW_ORC=ON \
> ..
> make -j
> make install
> cd ../../python
> python setup.py build_ext --bundle-arrow-cpp --with-orc --with-cuda
> --with-parquet bdist_wheel
> {code}
>
>
> With the generated whl package installed, ran CUDF tests and observed
> following error:
> *_ERROR cudf - ImportError:
> /conda/envs/rmm/lib/python3.7/site-packages/pyarrow/_orc.cpython-37m-powerpc64le-linux-gnu.so:
> undefined symbol: _ZN5arrow8adapters3orc13OR..._*
> Please find the whole error log below:
> ================================================================================
> ERRORS
> ================================================================================
> ____________________________________________________________________ ERROR
> collecting test session
> _____________________________________________________________________
> /conda/envs/rmm/lib/python3.7/importlib/__init__.py:127: in import_module
> return _bootstrap._gcd_import(name[level:], package, level)
> <frozen importlib._bootstrap>:1006: in _gcd_import
> ???
> <frozen importlib._bootstrap>:983: in _find_and_load
> ???
> <frozen importlib._bootstrap>:953: in _find_and_load_unlocked
> ???
> <frozen importlib._bootstrap>:219: in _call_with_frames_removed
> ???
> <frozen importlib._bootstrap>:1006: in _gcd_import
> ???
> <frozen importlib._bootstrap>:983: in _find_and_load
> ???
> <frozen importlib._bootstrap>:953: in _find_and_load_unlocked
> ???
> <frozen importlib._bootstrap>:219: in _call_with_frames_removed
> ???
> <frozen importlib._bootstrap>:1006: in _gcd_import
> ???
> <frozen importlib._bootstrap>:983: in _find_and_load
> ???
> <frozen importlib._bootstrap>:967: in _find_and_load_unlocked
> ???
> <frozen importlib._bootstrap>:677: in _load_unlocked
> ???
> <frozen importlib._bootstrap_external>:728: in exec_module
> ???
> <frozen importlib._bootstrap>:219: in _call_with_frames_removed
> ???
> cudf/cudf/__init__.py:60: in <module>
> from cudf.io import (
> cudf/cudf/io/__init__.py:8: in <module>
> from cudf.io.orc import read_orc, read_orc_metadata, to_orc
> cudf/cudf/io/orc.py:6: in <module>
> from pyarrow import orc as orc
> /conda/envs/rmm/lib/python3.7/site-packages/pyarrow/orc.py:24: in <module>
> import pyarrow._orc as _orc
> {color:#de350b}E ImportError:
> /conda/envs/rmm/lib/python3.7/site-packages/pyarrow/_orc.cpython-37m-powerpc64le-linux-gnu.so:
> undefined symbol:
> _ZN5arrow8adapters3orc13ORCFileReader4ReadEPSt10shared_ptrINS_5TableEE{color}
> =======================================================================
> short test summary info
> ========================================================================
> *_ERROR cudf - ImportError:
> /conda/envs/rmm/lib/python3.7/site-packages/pyarrow/_orc.cpython-37m-powerpc64le-linux-gnu.so:
> undefined symbol: _ZN5arrow8adapters3orc13OR..._*
> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
> Interrupted: 1 error during collection
> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
> ===========================================================================
> 1 error in 1.54s
> ===========================================================================
> Fatal Python error: Segmentation fault
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
