I stringed together a set of installation instructions to help future Python developers.
The PR is here https://github.com/apache/arrow/pull/105 On Wed, Jul 6, 2016 at 2:28 PM, Wes McKinney <wesmck...@gmail.com> wrote: > You can look at the Travis CI scripts to see the build procedure for > each component: > > https://github.com/apache/arrow/tree/master/ci > > While developing, I usually install things like parquet-cpp in > $HOME/local and set $PARQUET_HOME (or any other dependency env > variables) to that directory. > > We haven't put much effort into dealing with the optional dependencies > of pyarrow, or even deciding what is optional vs required. So for now > installing parquet-cpp is needed for building the Python extensions. > > - Wes > > On Wed, Jul 6, 2016 at 11:05 AM, Manoj Kumar > <manojkumarsivaraj...@gmail.com> wrote: > > Hi, > > > > I have problems in installing the Python port of arrow. It seems that it > > requires parquet-cpp. > > > > So I installed parquet-cpp from source using the following instructions > > here (https://github.com/apache/parquet-cpp) > > > > Doing "cmake ." and "make" from the parquet-cpp root directory, seems to > > work hinting that parquet-cpp seems to be installed succesfully. > > > > However, doing "sudo python3 setup.py install" from the python root > > directory fails with the error, > > > > "Could not find the Parquet library. Looked in system search paths." > > > > What do I need to set "PARQUET_HOME" to be to install the python port? > > > > Thanks! > > > > > > > > > > > > On Tue, Jul 5, 2016 at 3:47 PM, Manoj Kumar < > manojkumarsivaraj...@gmail.com> > > wrote: > > > >> Hi Wes, > >> > >> I updated Boost and it works now. > >> > >> I'll send a pull request to make a note for that soon. > >> > >> On Tue, Jul 5, 2016 at 3:30 PM, Wes McKinney <wesmck...@gmail.com> > wrote: > >> > >>> Oops, had a keyboarding failure. I got cmake 2.8.12.2 via yum on > >>> CentOS 6 after installing the devtoolset. > >>> > >>> On Tue, Jul 5, 2016 at 3:29 PM, Wes McKinney <wesmck...@gmail.com> > wrote: > >>> > hi Manoj, > >>> > > >>> > What is the output of > >>> > > >>> > cmake --version > >>> > > >>> > I installed the RHEL devtoolset using the set of commands in > >>> > > >>> > > >>> > https://github.com/conda-forge/docker-images/blob/master/linux-anvil/Dockerfile > >>> > > >>> > I had to run > >>> > > >>> > scl enable devtoolset-2 bash > >>> > x > >>> > and am able to build the thirdparty on CentOS 6.8. > >>> > > >>> > > >>> > https://github.com/conda-forge/docker-images/blob/master/linux-anvil/Dockerfile > >>> > > >>> > I hit another bug due to old boost-devel in CentOS, so I'd need to > >>> > look more into that > >>> > > >>> > - Wes > >>> > > >>> > On Tue, Jul 5, 2016 at 10:40 AM, Manoj Kumar > >>> > <manojkumarsivaraj...@gmail.com> wrote: > >>> >> Hi all, > >>> >> > >>> >> Thanks for the tips. I upgraded gcc to support C++11. > >>> >> > >>> >> g++ --version > >>> >> g++ (GCC) 4.8.2 20140120 (Red Hat 4.8.2-15) > >>> >> Copyright (C) 2013 Free Software Foundation, Inc. > >>> >> > >>> >> But I still get the error. Here is the full traceback: > >>> >> > >>> >> https://gist.github.com/MechCoder/2f97e53c35d36bb132d118f9abc7a255 > >>> >> > >>> >> Any help would be appreciated. > >>> >> > >>> >> > >>> >> > >>> >> On Fri, Jul 1, 2016 at 4:59 PM, Micah Kornfield < > emkornfi...@gmail.com > >>> > > >>> >> wrote: > >>> >> > >>> >>> I think if c++11 was used to compile the library it might also fix > the > >>> >>> issue. > >>> >>> > >>> >>> On Friday, July 1, 2016, Holden Karau <hol...@pigscanfly.ca> > wrote: > >>> >>> > >>> >>> > So doing a bit of hunting it seems like this might be coming > since > >>> your > >>> >>> > missing some expected build libraries, namely you don't have any > of > >>> the > >>> >>> > expected regex libraries. I'm used to working on ubuntu/debian > >>> derived > >>> >>> > systems but it seems like installing something like `yum > >>> groupinstall > >>> >>> > "Development Tools"` might help install this and other related > >>> libraries > >>> >>> > you will probably find yourself needing. > >>> >>> > It might be useful to make a note of this in the README as well > on > >>> what > >>> >>> the > >>> >>> > expected/required native libraries are. > >>> >>> > > >>> >>> > On Fri, Jul 1, 2016 at 4:31 PM, Manoj Kumar < > >>> >>> > manojkumarsivaraj...@gmail.com <javascript:;>> > >>> >>> > wrote: > >>> >>> > > >>> >>> > > Hi, > >>> >>> > > > >>> >>> > > I am trying to install Arrow using the following instructions. > >>> >>> > > > >>> >>> > > ./cpp/thirdparty/download_thirdparty.sh > >>> >>> > > ./cpp/thirdparty/build_thirdparty.sh > >>> >>> > > > >>> >>> > > > >>> >>> > > It fails with this error: > >>> >>> > > > >>> >>> > > + cmake -DCMAKE_BUILD_TYPE=Release > >>> >>> > > > -DCMAKE_INSTALL_PREFIX=/home/manoj/arrow/cpp/thirdparty/installed > >>> >>> > > '-DCMAKE_CXX_FLAGS=-fPIC --std=c++0x' . > >>> >>> > > -- git Version: v0.0.0-dirty > >>> >>> > > -- Version: 0.0.0 > >>> >>> > > -- Performing Test HAVE_STD_REGEX > >>> >>> > > -- Performing Test HAVE_STD_REGEX -- failed to compile > >>> >>> > > -- Performing Test HAVE_GNU_POSIX_REGEX > >>> >>> > > -- Performing Test HAVE_GNU_POSIX_REGEX -- failed to compile > >>> >>> > > -- Performing Test HAVE_POSIX_REGEX > >>> >>> > > -- Performing Test HAVE_POSIX_REGEX -- failed to compile > >>> >>> > > -- Performing Test HAVE_STEADY_CLOCK > >>> >>> > > -- Performing Test HAVE_STEADY_CLOCK -- failed to compile > >>> >>> > > CMake Error at src/CMakeLists.txt:17 (message): > >>> >>> > > Failed to determine the source files for the regular > expression > >>> >>> > backend. > >>> >>> > > > >>> >>> > > > >>> >>> > > I use CentOS version: 6.7 > >>> >>> > > > >>> >>> > > Any help to fix this, would be appreciated. Thanks! > >>> >>> > > > >>> >>> > > -- > >>> >>> > > Manoj, > >>> >>> > > http://github.com/MechCoder > >>> >>> > > > >>> >>> > > >>> >>> > > >>> >>> > > >>> >>> > -- > >>> >>> > Cell : 425-233-8271 > >>> >>> > Twitter: https://twitter.com/holdenkarau > >>> >>> > > >>> >>> > >>> >> > >>> >> > >>> >> > >>> >> -- > >>> >> Manoj, > >>> >> http://github.com/MechCoder > >>> > >> > >> > >> > >> -- > >> Manoj, > >> http://github.com/MechCoder > >> > > > > > > > > -- > > Manoj, > > http://github.com/MechCoder > -- Manoj, http://github.com/MechCoder
