Here is the best I can do. The config.log is too large to email. grep pmi config.log $ ./configure --prefix=/usr/local/ --with-cuda --with-slurm --with-pmi=/usr/local/slurm/include/slurm --with pmi-libdir=/usr/local/slurm/lib64 configure:71744: result: '--prefix=/usr/local/' '--with-cuda' '--with-slurm' '--with-pmi=/usr/local/slurm/include/slurm' '--with-pmi-libdir=/usr/local/slurm/lib64' configure:85150: checking for pmi.h in /usr/local/slurm/include/slurm configure:85208: checking pmi.h usability configure:85208: checking pmi.h presence configure:85208: checking for pmi.h configure:85270: checking for libpmi in /usr/local/slurm/lib64 configure:85277: checking for PMI_Init in -lpmi configure:85302: gcc -std=gnu99 -o conftest -O3 -DNDEBUG -finline-functions -fno-strict-aliasing -mcx16 -pthread -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/hwloc/hwloc1117/hwloc/include -I/usr/local/slurm/include/slurm -L/usr/local/slurm/lib64 conftest.c -lpmi -lm -lutil -lz -lpmi >&5 configure:85481: checking for pmi2.h in /usr/local/slurm/include/slurm configure:85539: checking pmi2.h usability configure:85539: checking pmi2.h presence configure:85539: checking for pmi2.h configure:85601: checking for libpmi2 in /usr/local/slurm/lib64 configure:85608: checking for PMI2_Init in -lpmi2 configure:85633: gcc -std=gnu99 -o conftest -O3 -DNDEBUG -finline-functions -fno-strict-aliasing -mcx16 -pthread -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/hwloc/hwloc1117/hwloc/include -I/usr/local/slurm/include/slurm -L/usr/local/slurm/lib64 conftest.c -lpmi2 -lm -lutil -lz -lpmi2 >&5 configure:86063: result: common, allocator, backtrace, btl, compress, crs, dl, event, hwloc, if, installdirs, memchecker, memcpy, memory, mpool, patcher, pmix, pstat, rcache, reachable, shmem, timer configure:130096: running /bin/sh './configure' --disable-dns --disable-http --disable-rpc --disable-openssl --enable-thread-support --disable-evport '--prefix=/usr/local/' '--with-cuda' '--with-slurm' '--with-pmi=/usr/local/slurm/include/slurm' '--with-pmi-libdir=/usr/local/slurm/lib64' 'CPPFLAGS=-I/usr/local/src/openmpi/openmpi-3.1.2 -I/usr/local/src/openmpi/openmpi-3.1.2 -I/usr/local/src/openmpi/openmpi-3.1.2/opal/include -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/hwloc/hwloc1117/hwloc/include -Drandom=opal_random' --cache-file=/dev/null --srcdir=. --disable-option-checking configure:5903: +++ Configuring MCA framework pmix configure:146895: checking for no configure components in framework pmix configure:146899: checking for m4 configure components in framework pmix configure:146901: result: cray, ext1x, ext2x, flux, pmix2x, s1, s2 configure:5918: --- MCA component pmix:isolated (no configuration) configure:146996: checking for MCA component pmix:isolated compile mode configure:147038: checking if MCA component pmix:isolated can compile configure:5918: --- MCA component pmix:cray (m4 configuration macro) configure:147646: checking for MCA component pmix:cray compile mode configure:147691: $PKG_CONFIG --exists --print-errors "cray-pmi" Package cray-pmi was not found in the pkg-config search path. Perhaps you should add the directory containing `cray-pmi.pc' No package 'cray-pmi' found configure:147708: $PKG_CONFIG --exists --print-errors "cray-pmi" Package cray-pmi was not found in the pkg-config search path. Perhaps you should add the directory containing `cray-pmi.pc' No package 'cray-pmi' found configure:147725: $PKG_CONFIG --exists --print-errors "cray-pmi" Package cray-pmi was not found in the pkg-config search path. Perhaps you should add the directory containing `cray-pmi.pc' No package 'cray-pmi' found No package 'cray-pmi' found configure:149038: checking if MCA component pmix:cray can compile configure:5918: --- MCA component pmix:ext1x (m4 configuration macro) configure:149182: checking for MCA component pmix:ext1x compile mode configure:149748: checking if MCA component pmix:ext1x can compile configure:5918: --- MCA component pmix:ext2x (m4 configuration macro) configure:149892: checking for MCA component pmix:ext2x compile mode configure:150447: checking if MCA component pmix:ext2x can compile configure:5918: --- MCA component pmix:flux (m4 configuration macro) configure:150591: checking for MCA component pmix:flux compile mode configure:150802: checking if MCA component pmix:flux can compile configure:5918: --- MCA component pmix:pmix2x (m4 configuration macro) configure:151409: checking for MCA component pmix:pmix2x compile mode configure:151568: OPAL configuring in opal/mca/pmix/pmix2x/pmix configure:151649: running /bin/sh './configure' --enable-embedded-mode --disable-debug --with-pmix-symbol-rename=OPAL_MCA_PMIX2X_ --disable-pmix-timing --without-tests-examples --disable-pmix-backward-compatibility --disable-visibility --enable-embedded-libevent --with-libevent-header=\"opal/mca/event/libevent2022/libevent2022.h\" '--prefix=/usr/local/' '--with-cuda' '--with-slurm' '--with-pmi=/usr/local/slurm/include/slurm' '--with-pmi-libdir=/usr/local/slurm/lib64' 'CFLAGS=-O3 -DNDEBUG ' 'CPPFLAGS=-I/usr/local/src/openmpi/openmpi-3.1.2 -I/usr/local/src/openmpi/openmpi-3.1.2 -I/usr/local/src/openmpi/openmpi-3.1.2/opal/include -I/usr/local/src/openmpi/openmpi-3.1.2/opal/include -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/event/libevent2022/libevent -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/event/libevent2022/libevent/include -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/hwloc/hwloc1117/hwloc/include ' --cache-file=/dev/null --srcdir=. --disable-option-checking configure:151655: /bin/sh './configure' succeeded for opal/mca/pmix/pmix2x/pmix configure:151809: checking if MCA component pmix:pmix2x can compile configure:5918: --- MCA component pmix:s1 (m4 configuration macro) configure:152416: checking for MCA component pmix:s1 compile mode configure:152478: checking if MCA component pmix:s1 can compile configure:5918: --- MCA component pmix:s2 (m4 configuration macro) configure:153085: checking for MCA component pmix:s2 compile mode configure:153147: checking if MCA component pmix:s2 can compile configure:177961: result: env, hnp, pmi, singleton, tool configure:5918: --- MCA component ess:pmi (no configuration) configure:179336: checking for MCA component ess:pmi compile mode configure:179378: checking if MCA component ess:pmi can compile config.status:4112: creating opal/mca/pmix/Makefile config.status:4112: creating opal/mca/pmix/isolated/Makefile config.status:4112: creating opal/mca/pmix/cray/Makefile config.status:4112: creating opal/mca/pmix/ext1x/Makefile config.status:4112: creating opal/mca/pmix/ext2x/Makefile config.status:4112: creating opal/mca/pmix/flux/Makefile config.status:4112: creating opal/mca/pmix/pmix2x/Makefile config.status:4112: creating opal/mca/pmix/s1/Makefile config.status:4112: creating opal/mca/pmix/s2/Makefile config.status:4112: creating orte/mca/ess/pmi/Makefile ac_cv_header_pmi2_h=yes ac_cv_header_pmi_h=yes ac_cv_lib_pmi2_PMI2_Init=yes ac_cv_lib_pmi_PMI_Init=yes MCA_BUILD_opal_pmix_cray_DSO_FALSE='#' MCA_BUILD_opal_pmix_cray_DSO_TRUE='' MCA_BUILD_opal_pmix_ext1x_DSO_FALSE='#' MCA_BUILD_opal_pmix_ext1x_DSO_TRUE='' MCA_BUILD_opal_pmix_ext2x_DSO_FALSE='#' MCA_BUILD_opal_pmix_ext2x_DSO_TRUE='' MCA_BUILD_opal_pmix_flux_DSO_FALSE='#' MCA_BUILD_opal_pmix_flux_DSO_TRUE='' MCA_BUILD_opal_pmix_isolated_DSO_FALSE='#' MCA_BUILD_opal_pmix_isolated_DSO_TRUE='' MCA_BUILD_opal_pmix_pmix2x_DSO_FALSE='#' MCA_BUILD_opal_pmix_pmix2x_DSO_TRUE='' MCA_BUILD_opal_pmix_s1_DSO_FALSE='#' MCA_BUILD_opal_pmix_s1_DSO_TRUE='' MCA_BUILD_opal_pmix_s2_DSO_FALSE='#' MCA_BUILD_opal_pmix_s2_DSO_TRUE='' MCA_BUILD_orte_ess_pmi_DSO_FALSE='#' MCA_BUILD_orte_ess_pmi_DSO_TRUE='' MCA_opal_FRAMEWORKS='common allocator backtrace btl compress crs dl event hwloc if installdirs memchecker memcpy memory mpool patcher pmix pstat rcache reachable shmem timer' MCA_opal_FRAMEWORKS_SUBDIRS='mca/common mca/allocator mca/backtrace mca/btl mca/compress mca/crs mca/dl mca/event mca/hwloc mca/if mca/installdirs mca/memchecker mca/memcpy mca/memory mca/mpool mca/patcher mca/pmix mca/pstat mca/rcache mca/reachable mca/shmem mca/timer' MCA_opal_FRAMEWORK_COMPONENT_ALL_SUBDIRS='$(MCA_opal_common_ALL_SUBDIRS) $(MCA_opal_allocator_ALL_SUBDIRS) $(MCA_opal_backtrace_ALL_SUBDIRS) $(MCA_opal_btl_ALL_SUBDIRS) $(MCA_opal_compress_ALL_SUBDIRS) $(MCA_opal_crs_ALL_SUBDIRS) $(MCA_opal_dl_ALL_SUBDIRS) $(MCA_opal_event_ALL_SUBDIRS) $(MCA_opal_hwloc_ALL_SUBDIRS) $(MCA_opal_if_ALL_SUBDIRS) $(MCA_opal_installdirs_ALL_SUBDIRS) $(MCA_opal_memchecker_ALL_SUBDIRS) $(MCA_opal_memcpy_ALL_SUBDIRS) $(MCA_opal_memory_ALL_SUBDIRS) $(MCA_opal_mpool_ALL_SUBDIRS) $(MCA_opal_patcher_ALL_SUBDIRS) $(MCA_opal_pmix_ALL_SUBDIRS) $(MCA_opal_pstat_ALL_SUBDIRS) $(MCA_opal_rcache_ALL_SUBDIRS) $(MCA_opal_reachable_ALL_SUBDIRS) $(MCA_opal_shmem_ALL_SUBDIRS) $(MCA_opal_timer_ALL_SUBDIRS)' MCA_opal_FRAMEWORK_COMPONENT_DSO_SUBDIRS='$(MCA_opal_common_DSO_SUBDIRS) $(MCA_opal_allocator_DSO_SUBDIRS) $(MCA_opal_backtrace_DSO_SUBDIRS) $(MCA_opal_btl_DSO_SUBDIRS) $(MCA_opal_compress_DSO_SUBDIRS) $(MCA_opal_crs_DSO_SUBDIRS) $(MCA_opal_dl_DSO_SUBDIRS) $(MCA_opal_event_DSO_SUBDIRS) $(MCA_opal_hwloc_DSO_SUBDIRS) $(MCA_opal_if_DSO_SUBDIRS) $(MCA_opal_installdirs_DSO_SUBDIRS) $(MCA_opal_memchecker_DSO_SUBDIRS) $(MCA_opal_memcpy_DSO_SUBDIRS) $(MCA_opal_memory_DSO_SUBDIRS) $(MCA_opal_mpool_DSO_SUBDIRS) $(MCA_opal_patcher_DSO_SUBDIRS) $(MCA_opal_pmix_DSO_SUBDIRS) $(MCA_opal_pstat_DSO_SUBDIRS) $(MCA_opal_rcache_DSO_SUBDIRS) $(MCA_opal_reachable_DSO_SUBDIRS) $(MCA_opal_shmem_DSO_SUBDIRS) $(MCA_opal_timer_DSO_SUBDIRS)' MCA_opal_FRAMEWORK_COMPONENT_STATIC_SUBDIRS='$(MCA_opal_common_STATIC_SUBDIRS) $(MCA_opal_allocator_STATIC_SUBDIRS) $(MCA_opal_backtrace_STATIC_SUBDIRS) $(MCA_opal_btl_STATIC_SUBDIRS) $(MCA_opal_compress_STATIC_SUBDIRS) $(MCA_opal_crs_STATIC_SUBDIRS) $(MCA_opal_dl_STATIC_SUBDIRS) $(MCA_opal_event_STATIC_SUBDIRS) $(MCA_opal_hwloc_STATIC_SUBDIRS) $(MCA_opal_if_STATIC_SUBDIRS) $(MCA_opal_installdirs_STATIC_SUBDIRS) $(MCA_opal_memchecker_STATIC_SUBDIRS) $(MCA_opal_memcpy_STATIC_SUBDIRS) $(MCA_opal_memory_STATIC_SUBDIRS) $(MCA_opal_mpool_STATIC_SUBDIRS) $(MCA_opal_patcher_STATIC_SUBDIRS) $(MCA_opal_pmix_STATIC_SUBDIRS) $(MCA_opal_pstat_STATIC_SUBDIRS) $(MCA_opal_rcache_STATIC_SUBDIRS) $(MCA_opal_reachable_STATIC_SUBDIRS) $(MCA_opal_shmem_STATIC_SUBDIRS) $(MCA_opal_timer_STATIC_SUBDIRS)' MCA_opal_FRAMEWORK_LIBS=' $(MCA_opal_common_STATIC_LTLIBS) mca/allocator/libmca_allocator.la $(MCA_opal_allocator_STATIC_LTLIBS) mca/backtrace/libmca_backtrace.la $(MCA_opal_backtrace_STATIC_LTLIBS) mca/btl/libmca_btl.la $(MCA_opal_btl_STATIC_LTLIBS) mca/compress/libmca_compress.la $(MCA_opal_compress_STATIC_LTLIBS) mca/crs/libmca_crs.la $(MCA_opal_crs_STATIC_LTLIBS) mca/dl/libmca_dl.la $(MCA_opal_dl_STATIC_LTLIBS) mca/event/libmca_event.la $(MCA_opal_event_STATIC_LTLIBS) mca/hwloc/libmca_hwloc.la $(MCA_opal_hwloc_STATIC_LTLIBS) mca/if/libmca_if.la $(MCA_opal_if_STATIC_LTLIBS) mca/installdirs/libmca_installdirs.la $(MCA_opal_installdirs_STATIC_LTLIBS) mca/memchecker/libmca_memchecker.la $(MCA_opal_memchecker_STATIC_LTLIBS) mca/memcpy/libmca_memcpy.la $(MCA_opal_memcpy_STATIC_LTLIBS) mca/memory/libmca_memory.la $(MCA_opal_memory_STATIC_LTLIBS) mca/mpool/libmca_mpool.la $(MCA_opal_mpool_STATIC_LTLIBS) mca/patcher/libmca_patcher.la $(MCA_opal_patcher_STATIC_LTLIBS) mca/pmix/libmca_pmix.la $(MCA_opal_pmix_STATIC_LTLIBS) mca/pstat/libmca_pstat.la $(MCA_opal_pstat_STATIC_LTLIBS) mca/rcache/libmca_rcache.la $(MCA_opal_rcache_STATIC_LTLIBS) mca/reachable/libmca_reachable.la $(MCA_opal_reachable_STATIC_LTLIBS) mca/shmem/libmca_shmem.la $(MCA_opal_shmem_STATIC_LTLIBS) mca/timer/libmca_timer.la $(MCA_opal_timer_STATIC_LTLIBS)' MCA_opal_pmix_ALL_COMPONENTS=' isolated cray ext1x ext2x flux pmix2x s1 s2' MCA_opal_pmix_ALL_SUBDIRS=' mca/pmix/isolated mca/pmix/cray mca/pmix/ext1x mca/pmix/ext2x mca/pmix/flux mca/pm x/pmix2x mca/pmix/s1 mca/pmix/s2' MCA_opal_pmix_DSO_COMPONENTS=' isolated flux pmix2x s1 s2' MCA_opal_pmix_DSO_SUBDIRS=' mca/pmix/isolated mca/pmix/flux mca/pmix/pmix2x mca/pmix/s1 mca/pmix/s2' MCA_opal_pmix_STATIC_COMPONENTS='' MCA_opal_pmix_STATIC_LTLIBS='' MCA_opal_pmix_STATIC_SUBDIRS='' MCA_orte_ess_ALL_COMPONENTS=' env hnp pmi singleton tool alps lsf slurm tm' MCA_orte_ess_ALL_SUBDIRS=' mca/ess/env mca/ess/hnp mca/ess/pmi mca/ess/singleton mca/ess/tool mca/ess/alps mca/ess/lsf mca/ess/slurm mca/ess/tm' MCA_orte_ess_DSO_COMPONENTS=' env hnp pmi singleton tool slurm' MCA_orte_ess_DSO_SUBDIRS=' mca/ess/env mca/ess/hnp mca/ess/pmi mca/ess/singleton mca/ess/tool mca/ess/slurm' OPAL_CONFIGURE_CLI=' \'\''--prefix=/usr/local/\'\'' \'\''--with-cuda\'\'' \'\''--with-slurm\'\'' \'\''--with-pmi=/usr/local/slurm/include/slurm\'\'' \'\''--with-pmi-libdir=/usr/local/slurm/lib64\'\''' opal_pmi1_CPPFLAGS='' opal_pmi1_LDFLAGS='' opal_pmi1_LIBS='-lpmi' opal_pmi1_rpath='' opal_pmi2_CPPFLAGS='' opal_pmi2_LDFLAGS='' opal_pmi2_LIBS='-lpmi2' opal_pmi2_rpath='' opal_pmix_ext1x_CPPFLAGS='' opal_pmix_ext1x_LDFLAGS='' opal_pmix_ext1x_LIBS='' opal_pmix_ext2x_CPPFLAGS='' opal_pmix_ext2x_LDFLAGS='' opal_pmix_ext2x_LIBS='' opal_pmix_pmix2x_CPPFLAGS='-I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x/pmix/include -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x/pmix -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x/pmix/include -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x/pmix' opal_pmix_pmix2x_DEPENDENCIES='/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x/pmix/src/libpmix.la' opal_pmix_pmix2x_LDFLAGS='' opal_pmix_pmix2x_LIBS='/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x/pmix/src/libpmix.la' pmix_alps_CPPFLAGS='' pmix_alps_LDFLAGS='' pmix_alps_LIBS='' pmix_cray_CPPFLAGS='' pmix_cray_LDFLAGS='' pmix_cray_LIBS=''
From: users <users-boun...@lists.open-mpi.org> On Behalf Of Ralph H Castain Sent: Wednesday, October 10, 2018 11:26 AM To: Open MPI Users <users@lists.open-mpi.org> Subject: Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm It appears that the CPPFLAGS isn’t getting set correctly as the component didn’t find the Slurm PMI-1 header file. Perhaps it would help if we saw the config.log output so we can see where OMPI thought the file was located. On Oct 10, 2018, at 6:44 AM, Ross, Daniel B. via users <users@lists.open-mpi.org<mailto:users@lists.open-mpi.org>> wrote: I have been able to configure without issue using the following options: ./configure --prefix=/usr/local/ --with-cuda --with-slurm --with-pmi=/usr/local/slurm/include/slurm --with-pmi-libdir=/usr/local/slurm/lib64 Everything compiles just fine until I get this error: make[3]: Leaving directory `/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x' make[2]: Leaving directory `/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x' Making all in mca/pmix/s1 make[2]: Entering directory `/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/s1' CC mca_pmix_s1_la-pmix_s1.lo pmix_s1.c:29:17: fatal error: pmi.h: No such file or directory #include <pmi.h> ^ compilation terminated. make[2]: *** [mca_pmix_s1_la-pmix_s1.lo] Error 1 make[2]: Leaving directory `/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/s1' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/local/src/openmpi/openmpi-3.1.2/opal' make: *** [all-recursive] Error 1 any ideas why I am getting this error? Thanks _______________________________________________ users mailing list users@lists.open-mpi.org<mailto:users@lists.open-mpi.org> https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
