Well, I do have my own dev version of libarrow (with my own modifications) manually installed. I can verify that the pip install went smoothly on my work computer which has none of the Arrow development I do after work. Moreover I did find that ORC has been reenabled in the wheel and have used both the reader and the writer without issues.
As for Conda I did manage to get the pyarrow 4.0.0 but there is no ORC functionality since any attempt to import from pyarrow.orc lead to an error caused by 'pyarrow._orc isn’t found'. Ying > On Apr 28, 2021, at 5:06 AM, Alessandro Molina <alessan...@ursacomputing.com> > wrote: > > Are you sure you haven't installed `libarrow` (the CPP one) manually > independently from pyarrow? > > In your traceback you have that the symbol has not been found in > "/usr/local/lib/libarrow.400.dylib" > > But that smells like an independently installed libarrow, as the libarrow > provided by pyarrow should exist in the pytnon environment (in my case for > example /usr/local/lib/python3.9/site-packages/pyarrow/libarrow.400.dylib > ) I suspect your system installed libarrow is taking precedence over the > one provided by pyarrow and the two might not match. > > On Wed, Apr 28, 2021 at 10:05 AM Ying Zhou <yzhou7...@gmail.com> wrote: > >> Hi, >> >> It turns out that I haven’t been able to use PyArrow 4.0.0 either in Conda >> environments or python venvs. PyArrow does install using pip. However this >> is what I get if I ever want to use it: >> >>>>> import pyarrow as pa >> Traceback (most recent call last): >> File "<stdin>", line 1, in <module> >> File >> "/Users/karlkatzen/anaconda3/lib/python3.8/site-packages/pyarrow/__init__.py", >> line 63, in <module> >> import pyarrow.lib as _lib >> ImportError: >> dlopen(/Users/karlkatzen/anaconda3/lib/python3.8/site-packages/pyarrow/ >> lib.cpython-38-darwin.so, 2): Symbol not found: >> __ZN5arrow10StopSource5tokenEv >> Referenced from: >> /Users/karlkatzen/anaconda3/lib/python3.8/site-packages/pyarrow/ >> lib.cpython-38-darwin.so >> Expected in: /usr/local/lib/libarrow.400.dylib >> in /Users/karlkatzen/anaconda3/lib/python3.8/site-packages/pyarrow/ >> lib.cpython-38-darwin.so >>>>> pa >> Traceback (most recent call last): >> File "<stdin>", line 1, in <module> >> NameError: name 'pa' is not defined >> >> On the other hand a Conda installation is not even possible. Does anyone >> know what’s going on? >> >> Ying
