$ ./configure --prefix=/usr/local/ --with-cuda --with-slurm
--with-pmi=/usr/local/slurm/include/slurm --with-
pmi-libdir=/usr/local/slurm/lib64 CPPFLAGS=-I/usr/local/slurm/include/slurm
LDFLAGS=-L/usr/local/slurm/lib64
seemed to work just fine.
Thanks for the assistance.
From: Charles A Taylor <chas...@ufl.edu>
Sent: Wednesday, October 10, 2018 6:02 PM
To: Open MPI Users <users@lists.open-mpi.org>
Cc: Ross, Daniel B. <ros...@ornl.gov>
Subject: Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm
In our config the "--with-pmi" points to the slurm “prefix” dir not the slurm
libdir. The options below work for us with SLURM installed in “/opt/slurm”.
I’ll note that after sharing this config with regard to another issue, it was
recommended to drop the “/usr” in the “—with-foo=/usr” options and simply
use “—with-foo”. That said, the configuration builds, runs, and works with
both pmi2 and pmix_v2 under SLURM (17.11.5).
Hope it helps,
Charlie Taylor
UF Research Computing
CFG_OPTS=""
CFG_OPTS="$CFG_OPTS C=icc CXX=icpc FC=ifort FFLAGS=\"-O2 -g -warn -m64\"
LDFLAGS=\"\" "
CFG_OPTS="$CFG_OPTS --enable-static"
CFG_OPTS="$CFG_OPTS --enable-orterun-prefix-by-default"
CFG_OPTS="$CFG_OPTS --with-slurm=/opt/slurm"
CFG_OPTS="$CFG_OPTS --with-pmix=/opt/pmix/2.1.1"
CFG_OPTS="$CFG_OPTS --with-pmi=/opt/slurm"
CFG_OPTS="$CFG_OPTS --with-libevent=external"
CFG_OPTS="$CFG_OPTS --with-hwloc=external"
CFG_OPTS="$CFG_OPTS --with-verbs=/usr"
CFG_OPTS="$CFG_OPTS --with-libfabric=/usr"
CFG_OPTS="$CFG_OPTS --with-ucx=/usr"
CFG_OPTS="$CFG_OPTS --with-verbs-libdir=/usr/lib64"
CFG_OPTS="$CFG_OPTS --with-mxm=no"
CFG_OPTS="$CFG_OPTS --with-cuda=${HPC_CUDA_DIR}"
CFG_OPTS="$CFG_OPTS --enable-openib-udcm"
CFG_OPTS="$CFG_OPTS --enable-openib-rdmacm”
On Oct 10, 2018, at 9:44 AM, Ross, Daniel B. via users
<users@lists.open-mpi.org<mailto:users@lists.open-mpi.org>> wrote:
I have been able to configure without issue using the following options:
./configure --prefix=/usr/local/ --with-cuda --with-slurm
--with-pmi=/usr/local/slurm/include/slurm
--with-pmi-libdir=/usr/local/slurm/lib64
Everything compiles just fine until I get this error:
make[3]: Leaving directory
`/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x'
make[2]: Leaving directory
`/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x'
Making all in mca/pmix/s1
make[2]: Entering directory
`/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/s1'
CC mca_pmix_s1_la-pmix_s1.lo
pmix_s1.c:29:17: fatal error: pmi.h: No such file or directory
#include <pmi.h>
^
compilation terminated.
make[2]: *** [mca_pmix_s1_la-pmix_s1.lo] Error 1
make[2]: Leaving directory
`/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/s1'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/usr/local/src/openmpi/openmpi-3.1.2/opal'
make: *** [all-recursive] Error 1
any ideas why I am getting this error?
Thanks
_______________________________________________
users mailing list
users@lists.open-mpi.org<mailto:users@lists.open-mpi.org>
https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.open-2Dmpi.org_mailman_listinfo_users&d=DwICAg&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=HOtXciFqK5GlgIgLAxthUQ&m=kx16f4bm7qZNj7skG8__z3EMDluM8L_LHYZHmA1ZhFI&s=YSuW5T_SPA66GoYyG95eakEqTMAdWuVKsuzdYU4N56A&e=
_______________________________________________
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users
