I want to build OpenMPI 1.8.7 on a Cray XC30 (Edison at NERSC). I've tried various configuration options, but I am always encountering either OpenMPI build errors, application build errors, or run-time errors.
I'm currently looking at < http://www.open-mpi.org/community/lists/users/2015/06/27230.php>, which seems to describe my case. I'm now configuring OpenMPI without any options, except setting compilers to clang/gfortran and pointing it to a self-built hwloc. For completeness, here are my configure options as recorded by config.status: '/project/projectdirs/m152/schnette/edison/software/src/openmpi-1.8.7/src/openmpi-1.8.7/configure' '--prefix=/project/projectdirs/m152/schnette/edison/software/openmpi-1.8.7' '--with-hwloc=/project/projectdirs/m152/schnette/edison/software/hwloc-1.11.0' '--disable-vt' 'CC=/project/projectdirs/m152/schnette/edison/software/llvm-3.6.2/bin/wrap-clang' 'CXX=/project/projectdirs/m152/schnette/edison/software/llvm-3.6.2/bin/wrap-clang++' 'FC=/project/projectdirs/m152/schnette/edison/software/gcc-5.2.0/bin/wrap-gfortran' 'CFLAGS=-I/opt/ofed/include -I/project/projectdirs/m152/schnette/edison/software/hwloc-1.11.0/include' 'CXXFLAGS=-I/opt/ofed/include -I/project/projectdirs/m152/schnette/edison/software/hwloc-1.11.0/include' 'LDFLAGS=-L/opt/ofed/lib64 -L/project/projectdirs/m152/schnette/edison/software/hwloc-1.11.0/lib -Wl,-rpath,/project/projectdirs/m152/schnette/edison/software/hwloc-1.11.0/lib' 'LIBS=-lhwloc -lpthread -lpthread' '--with-wrapper-ldflags=-L/project/projectdirs/m152/schnette/edison/software/hwloc-1.11.0/lib -Wl,-rpath,/project/projectdirs/m152/schnette/edison/software/hwloc-1.11.0/lib' '--with-wrapper-libs=-lhwloc -lpthread' This builds and installs fine, and works when running on a single node. However, multi-node runs are stalling: The queue starts the job, but mpirun produces no output. The "-v" option to mpirun doesn't help. When I use aprun instead of mpirun to start my application, then all processes think they are rank 0. Do you have any pointers for how to debug this? -erik -- Erik Schnetter <schnet...@gmail.com> http://www.perimeterinstitute.ca/personal/eschnetter/
