Many thanks to all who replied and especially to Artem Polyakov of Mellanox who provided a slurm-15.08.13 specific pmix patch. That patch applied and built cleanly against the 15.08.13 tarball and better yet, it works.
Regards, Charles A. Taylor UF Research Computing > On Aug 6, 2017, at 9:14 AM, Charles A Taylor <chas...@ufl.edu> wrote: > > HI Gilles, > > I tried both “—with-pmix=/opt/pmix” and “—with-pmix=internal” and got the > same “UNREACHABLE” error both ways. I tried the “external” first since that > is what SLURM was built against. > > I’m missing something simple/basic - just not sure what it is. > > Thanks, > > Charlie > >> On Aug 6, 2017, at 7:43 AM, Gilles Gouaillardet >> <gilles.gouaillar...@gmail.com> wrote: >> >> Charles, >> >> did you build Open MPI with the external PMIx ? >> iirc, Open MPI 2.0.x does not support cross version PMIx >> >> Cheers, >> >> Gilles >> >> On Sun, Aug 6, 2017 at 7:59 PM, Charles A Taylor <chas...@ufl.edu> wrote: >>> >>>> On Aug 6, 2017, at 6:53 AM, Charles A Taylor <chas...@ufl.edu> wrote: >>>> >>>> >>>> Anyone successfully using PMIx with OpenMPI and SLURM? I have, >>>> >>>> 1. Installed an “external” version (1.1.5) of PMIx. >>>> 2. Patched SLURM 15.08.13 with the SchedMD-provided PMIx patch (results in >>>> an mpi_pmix plugin along the lines of mpi_pmi2). >>>> 3. Built OpenMPI 2.0.1 (tried 2.0.3 as well). >>>> >>>> However, when attempting to launch MPI apps (LAMMPS in this case), I get >>>> >>>> [c9a-s2.ufhpc:08914] PMIX ERROR: UNREACHABLE in file >>>> src/client/pmix_client.c at line 199 >>>> >>> I should have mentioned that I’m launching with >>> >>> srun —mpi=pmix … >>> >>> If I launch with >>> >>> srun —mpi=pmi2 ... >>> >>> the app starts and runs without issue. >>> >>> >>> _______________________________________________ >>> users mailing list >>> users@lists.open-mpi.org >>> https://lists.open-mpi.org/mailman/listinfo/users >> _______________________________________________ >> users mailing list >> users@lists.open-mpi.org >> https://lists.open-mpi.org/mailman/listinfo/users > > _______________________________________________ > users mailing list > users@lists.open-mpi.org > https://lists.open-mpi.org/mailman/listinfo/users _______________________________________________ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
