Remove the extra configure options from OMPI - you don't need to tell it --with-pmix or --with-slurm. It will "do the right thing" without that stuff.
On Aug 8, 2019, at 10:54 AM, Jing Gong <gongj...@kth.se <mailto:gongj...@kth.se> > wrote: Hi Ralph, The slurm seems to be configured with pmlx. $ ls /usr/lib64/slurm/ |grep pmi acct_gather_energy_ipmi.so mpi_pmi2.so mpi_pmix.so mpi_pmix_v1.so (and libpmix* in /usr/lib64) Anyway, I recompiled openmpi v3.0.0 with $ ./configure --with-pmix=/usr --with-slurm ... but this time I even could not run "mpirun" $ mpirun -n 4 ./a.out [[42812,0],0] ORTE_ERROR_LOG: Not found in file ../../../../../openmpi-3.0.0/orte/mca/ess/hnp/ess_hnp_module.c at line 649 -------------------------------------------------------------------------- It looks like orte_init failed for some reason; your parallel process is likely to abort. There are many reasons that a parallel process can fail during orte_init; some of which are due to configuration or environment problems. This failure appears to be an internal failure; here's some additional information (which may only be relevant to an Open MPI developer): opal_pmix_base_select failed --> Returned value Not found (-13) instead of ORTE_SUCCESS -------------------------------------------------------------------------- What is the issue? Thanks a lot. /Jing -------------------------------- From: users <users-boun...@lists.open-mpi.org <mailto:users-boun...@lists.open-mpi.org> > on behalf of Ralph Castain via users <users@lists.open-mpi.org <mailto:users@lists.open-mpi.org> > Sent: Thursday, August 8, 2019 16:41 To: Open MPI Users Cc: Ralph Castain Subject: Re: [OMPI users] OMPI was not built with SLURM's PMI support Did you configure Slurm to use PMIx? If so, then you simply need to set the "--mpi=pmix" or "--mpi=pmix_v2" (depending on which version of PMIx you used) flag on your srun cmd line so it knows to use it. If not (and you can't fix it), then you have to explicitly configure OMPI to use Slurm's legacy PMI libraries - we won't do that by default. "./configure --help" will show you what needs to be done. See https://slurm.schedmd.com/mpi_guide.html for assistance on checking your Slurm config and setting it up with PMIx support Ralph
_______________________________________________ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
