Re: [OMPI users] Error in file base/plm_base_launch_support.c: OPAL_HWLOC_TOPO

2018-07-24 Thread Lovelace III, Henry
Hi,

   I am receiving these errors when building with OpenMPI on the NERSC system.

Building directory: util_programs

-- The C compiler identification is GNU 7.1.0
-- The CXX compiler identification is GNU 7.1.0
-- Cray Programming Environment 2.5.12 C
-- Check for working C compiler: /opt/cray/pe/craype/2.5.12/bin/cc
-- Check for working C compiler: /opt/cray/pe/craype/2.5.12/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Cray Programming Environment 2.5.12 CXX
-- Check for working CXX compiler: /opt/cray/pe/craype/2.5.12/bin/CC
-- Check for working CXX compiler: /opt/cray/pe/craype/2.5.12/bin/CC -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- The Fortran compiler identification is GNU 7.1.0
-- Check for working Fortran compiler: 
/global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/production/bin/mpifort
-- Check for working Fortran compiler: 
/global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/production/bin/mpifort  -- 
works
-- Detecting Fortran compiler ABI info
-- Detecting Fortran compiler ABI info - done
-- Checking whether 
/global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/production/bin/mpifort 
supports Fortran 90
-- Checking whether 
/global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/production/bin/mpifort 
supports Fortran 90 -- yes

Build type   : Production
Linking with release : /global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724 
(Off-site Distribution)
C Compiler   : /opt/cray/pe/craype/2.5.12/bin/cc
Fortran Compiler : 
/global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/production/bin/mpifort
Plotting Libraries   : pgplot
OpenMP Support   : Not Enabled
MPI Support  : Enabled
FFLAGS   :
gfortran Compiler Flags : -Df2cFortran -DCESR_UNIX -DCESR_LINUX -u -traceback 
-cpp -fno-range-check -fdollar-ok -fbacktrace -Bstatic -ffree-line-length-none 
-DCESR_PGPLOT 
-I/global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/production/include -pthread 
-I/global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/production/lib -fPIC -O2
gfortran Linker Flags   : -pthread 
-I/global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/production/lib -Wl,-rpath 
-Wl,/global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/production/lib 
-Wl,--enable-new-dtags 
-L/global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/production/lib 
-lmpi_usempif08 -lmpi_usempi_ignore_tkr -lmpi_mpifh -lmpi;-lX11

SHARED DEPS  :

-- Configuring done
-- Generating done
-- Build files have been written to: 
/global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/util_programs/production
Scanning dependencies of target compare_tracking_methods_text-exe
Scanning dependencies of target compare_tracking_methods_plot-exe
Scanning dependencies of target f77_to_f90-exe
Scanning dependencies of target util_programs
Scanning dependencies of target lattice_cleaner-exe
Scanning dependencies of target bmad_to_gpt-exe
Scanning dependencies of target bmad_to_mad_sad_and_xsif-exe
Scanning dependencies of target sad_to_bmad_postprocess-exe
Scanning dependencies of target aspea2-exe
Scanning dependencies of target bmad_to_csrtrack-exe
Scanning dependencies of target ansga2-exe
Scanning dependencies of target bmad_to_blender-exe
Scanning dependencies of target bmad_to_autocad-exe
Scanning dependencies of target element_attributes-exe
Scanning dependencies of target wake_fit-exe
Scanning dependencies of target envelope_ibs-exe
[  1%] Building Fortran object 
CMakeFiles/compare_tracking_methods_text-exe.dir/compare_tracking_methods_text/compare_tracking_methods_text.f90.o
[  3%] Building Fortran object 
CMakeFiles/f77_to_f90-exe.dir/f77_to_f90/f77_to_f90.f90.o
[  5%] Building Fortran object 
CMakeFiles/compare_tracking_methods_plot-exe.dir/compare_tracking_methods_plot/compare_tracking_methods_plot.f90.o
[  7%] Building Fortran object 
CMakeFiles/lattice_cleaner-exe.dir/lattice_cleaner/lattice_cleaner.f90.o
[  9%] Building Fortran object 
CMakeFiles/sad_to_bmad_postprocess-exe.dir/sad_to_bmad/sad_to_bmad_postprocess.f90.o
[ 11%] Building Fortran object 
CMakeFiles/bmad_to_gpt-exe.dir/bmad_to_gpt/bmad_to_gpt.f90.o
[ 13%] Building Fortran object 
CMakeFiles/bmad_to_mad_sad_and_xsif-exe.dir/bmad_to_mad_sad_and_xsif/bmad_to_mad_sad_and_xsif.f90.o
[ 15%] Building Fortran object 
CMakeFiles/bmad_to_csrtrack-exe.dir/bmad_to_csrtrack/bmad_to_csrtrack.f90.o
[ 16%] Building Fortran object 
CMakeFiles/element_attributes-exe.dir/element_attributes/element_attributes.f90.o
[ 22%] Building Fortran object 
CMakeFiles/bmad_to_autocad-exe.dir/bmad_to_autocad/bmad_to_autocad.f90.o
[ 22%] Building Fortran object 
CMakeFiles/wake_fit-exe.dir/wake_fit/wake_fit.f90.o
[ 22%] Building Fortran object 
CMakeFiles/envelope_ibs-exe.dir/envelope_ibs/envelope_ibs.f90.o
[ 24%] Building Fortran object 
CMakeFiles/bmad_to_blender-exe.dir/bmad_

Re: [OMPI users] Error in file base/plm_base_launch_support.c: OPAL_HWLOC_TOPO

2018-07-24 Thread gilles
 Henry,

First, you could/should use mpicc instead of the cc cray compiler


I also noted


gfortran Linker Flags   : -pthread -I/global/homes/h/hlovelac/BMAD/bmad_
dist_2018_0724/production/lib -Wl,-rpath -Wl,/global/homes/h/hlovelac/
BMAD/bmad_dist_2018_0724/production/lib -Wl,--enable-new-dtags -L/global
/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/production/lib -lmpi_
usempif08 -lmpi_usempi_ignore_tkr -lmpi_mpifh -lmpi;-lX11


It should be '-lmpi -lX11' instead of '-lmpi;-lX11'


The linker flags suggest Open MPI is installed in /global/homes/h/
hlovelac/BMAD/bmad_dist_2018_0724/production/lib, but your LD_LIBRARY_
PATH suggests it is in
$HOME/BMAD/bmad_dist_2018_0717/production/lib

(note 0724 vs 0717)

Also, keep in mind LD_LIBRARY_PATH is only used at runtime in order to 
resolve dependencies.

The linker does *not* use LD_LIBRARY_PATH.

IIRC, it uses LIBRARY_PATH, but the preferred way is to use the -L 
argument.

If your problem persists, I suggest you get the full command line that 
is failing.

(It should invoke mpifort instead gfortran or cc). Then you can copy/
paste the mpifort command, add the

-showme parameter, and run it manually so we can understand what is 
really hapenning under the(cmake) hood.

Cheers,

Gilles

- Original Message -

Hi,

   I am receiving these errors when building with OpenMPI on the 
NERSC system.
Building directory: util_programs

-- The C compiler identification is GNU 7.1.0
-- The CXX compiler identification is GNU 7.1.0
-- Cray Programming Environment 2.5.12 C
-- Check for working C compiler: /opt/cray/pe/craype/2.5.12/bin/cc
-- Check for working C compiler: /opt/cray/pe/craype/2.5.12/bin/cc -
- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Cray Programming Environment 2.5.12 CXX
-- Check for working CXX compiler: /opt/cray/pe/craype/2.5.12/bin/CC
-- Check for working CXX compiler: /opt/cray/pe/craype/2.5.12/bin/CC 
-- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- The Fortran compiler identification is GNU 7.1.0
-- Check for working Fortran compiler: /global/homes/h/hlovelac/BMAD
/bmad_dist_2018_0724/production/bin/mpifort
-- Check for working Fortran compiler: /global/homes/h/hlovelac/BMAD
/bmad_dist_2018_0724/production/bin/mpifort  -- works
-- Detecting Fortran compiler ABI info
-- Detecting Fortran compiler ABI info - done
-- Checking whether /global/homes/h/hlovelac/BMAD/bmad_dist_2018_
0724/production/bin/mpifort supports Fortran 90
-- Checking whether /global/homes/h/hlovelac/BMAD/bmad_dist_2018_
0724/production/bin/mpifort supports Fortran 90 -- yes

Build type   : Production
Linking with release : /global/homes/h/hlovelac/BMAD/bmad_dist_2018_
0724 (Off-site Distribution)
C Compiler   : /opt/cray/pe/craype/2.5.12/bin/cc
Fortran Compiler : /global/homes/h/hlovelac/BMAD/bmad_dist_2018_
0724/production/bin/mpifort
Plotting Libraries   : pgplot
OpenMP Support   : Not Enabled
MPI Support  : Enabled
FFLAGS   :  
gfortran Compiler Flags : -Df2cFortran -DCESR_UNIX -DCESR_LINUX -u -
traceback -cpp -fno-range-check -fdollar-ok -fbacktrace -Bstatic -ffree-
line-length-none -DCESR_PGPLOT -I/global/homes/h/hlovelac/BMAD/bmad_dist
_2018_0724/production/include -pthread -I/global/homes/h/hlovelac/BMAD/
bmad_dist_2018_0724/production/lib -fPIC -O2
gfortran Linker Flags   : -pthread -I/global/homes/h/hlovelac/BMAD/
bmad_dist_2018_0724/production/lib -Wl,-rpath -Wl,/global/homes/h/
hlovelac/BMAD/bmad_dist_2018_0724/production/lib -Wl,--enable-new-dtags 
-L/global/homes/h/hlovelac/BMAD/bmad_dist_2018_0724/production/lib -lmpi
_usempif08 -lmpi_usempi_ignore_tkr -lmpi_mpifh -lmpi;-lX11

SHARED DEPS  :

-- Configuring done
-- Generating done
-- Build files have been written to: /global/homes/h/hlovelac/BMAD/
bmad_dist_2018_0724/util_programs/production
Scanning dependencies of target compare_tracking_methods_text-exe
Scanning dependencies of target compare_tracking_methods_plot-exe
Scanning dependencies of target f77_to_f90-exe
Scanning dependencies of target util_programs
Scanning dependencies of target lattice_cleaner-exe
Scanning dependencies of target bmad_to_gpt-exe
Scanning dependencies of target bmad_to_mad_sad_and_xsif-exe
Scanning dependencies of target sad_to_bmad_postprocess-exe
Scanning dependencies of target aspea2-exe
Scanning dependencies of target bmad_to_csrtrack-exe
Scanning dependencies of target ansga2-exe
Scanning dependencies of target bmad_to_blender-exe
Scanning dependencies of target bmad_to_autocad-exe
Scanning dependencies of target element_attributes-exe
S