In general, it isn't a good idea to install into /usr (or whatever is the default path for your system) when you are doing development. I strongly recommend using isolated install paths and using LD_LIBRARY_PATH when you want to use your particular development version in an application.
On Wed, Apr 28, 2021 at 7:55 AM Ying Zhou <yzhou7...@gmail.com> wrote: > Well, I do have my own dev version of libarrow (with my own modifications) > manually installed. I can verify that the pip install went smoothly on my > work computer which has none of the Arrow development I do after work. > Moreover I did find that ORC has been reenabled in the wheel and have used > both the reader and the writer without issues. > > As for Conda I did manage to get the pyarrow 4.0.0 but there is no ORC > functionality since any attempt to import from pyarrow.orc lead to an error > caused by 'pyarrow._orc isn’t found'. > > Ying > > > > > On Apr 28, 2021, at 5:06 AM, Alessandro Molina < > alessan...@ursacomputing.com> wrote: > > > > Are you sure you haven't installed `libarrow` (the CPP one) manually > > independently from pyarrow? > > > > In your traceback you have that the symbol has not been found in > > "/usr/local/lib/libarrow.400.dylib" > > > > But that smells like an independently installed libarrow, as the libarrow > > provided by pyarrow should exist in the pytnon environment (in my case > for > > example > /usr/local/lib/python3.9/site-packages/pyarrow/libarrow.400.dylib > > ) I suspect your system installed libarrow is taking precedence over the > > one provided by pyarrow and the two might not match. > > > > On Wed, Apr 28, 2021 at 10:05 AM Ying Zhou <yzhou7...@gmail.com> wrote: > > > >> Hi, > >> > >> It turns out that I haven’t been able to use PyArrow 4.0.0 either in > Conda > >> environments or python venvs. PyArrow does install using pip. However > this > >> is what I get if I ever want to use it: > >> > >>>>> import pyarrow as pa > >> Traceback (most recent call last): > >> File "<stdin>", line 1, in <module> > >> File > >> > "/Users/karlkatzen/anaconda3/lib/python3.8/site-packages/pyarrow/__init__.py", > >> line 63, in <module> > >> import pyarrow.lib as _lib > >> ImportError: > >> dlopen(/Users/karlkatzen/anaconda3/lib/python3.8/site-packages/pyarrow/ > >> lib.cpython-38-darwin.so, 2): Symbol not found: > >> __ZN5arrow10StopSource5tokenEv > >> Referenced from: > >> /Users/karlkatzen/anaconda3/lib/python3.8/site-packages/pyarrow/ > >> lib.cpython-38-darwin.so > >> Expected in: /usr/local/lib/libarrow.400.dylib > >> in /Users/karlkatzen/anaconda3/lib/python3.8/site-packages/pyarrow/ > >> lib.cpython-38-darwin.so > >>>>> pa > >> Traceback (most recent call last): > >> File "<stdin>", line 1, in <module> > >> NameError: name 'pa' is not defined > >> > >> On the other hand a Conda installation is not even possible. Does anyone > >> know what’s going on? > >> > >> Ying > >
