Re: [OMPI users] Building PMIx and Slurm support

2019-03-12 Thread Gilles Gouaillardet
i.org Subject: Re: [OMPI users] Building PMIx and Slurm support Passant, Except the typo (it should be srun --mpi=pmix_v3), there is nothing wrong with that, and it is working just fine for me (same SLURM version, same PMIx version, same Open MPI version and same Open MPI configure command line) th

Re: [OMPI users] Building PMIx and Slurm support

2019-03-12 Thread Daniel Letai
lists.open-mpi.org Subject: Re: [OMPI users] Building PMIx and Slurm support Passant, Except the typo (it should be srun --mpi=pmix_v3), there is nothing wrong with that, and it is working just fine for me (same SLURM version, same PMIx version, same Open MPI version and same Open MPI configure co

Re: [OMPI users] Building PMIx and Slurm support

2019-03-12 Thread Passant A. Hafez
lf of Gilles Gouaillardet Sent: Tuesday, March 12, 2019 8:22 AM To: users@lists.open-mpi.org Subject: Re: [OMPI users] Building PMIx and Slurm support Passant, Except the typo (it should be srun --mpi=pmix_v3), there is nothing wrong with that, and it is working just fine for me (same SLURM version,

Re: [OMPI users] Building PMIx and Slurm support

2019-03-11 Thread Gilles Gouaillardet
d Technology > Building 1, Al-Khawarizmi, Room 0123 > Mobile : +966 (0) 55-247-9568 > Mobile : +20 (0) 106-146-9644 > Office : +966 (0) 12-808-0367 > ------------ > *From:* users on behalf of Ralph H > Castain > *Sent:* Mon

Re: [OMPI users] Building PMIx and Slurm support

2019-03-11 Thread Passant A. Hafez
------- > *From:* users on behalf of Ralph H > Castain > *Sent:* Monday, March 4, 2019 5:29 PM > *To:* Open MPI Users > *Subject:* Re: [OMPI users] Building PMIx and Slurm support > > >> On Mar 4, 2019, at 5:34 AM, Daniel Letai > <mailto:d...@letai.org.il>&g

Re: [OMPI users] Building PMIx and Slurm support

2019-03-11 Thread Gilles Gouaillardet
-0367 *From:* users on behalf of Ralph H Castain *Sent:* Monday, March 4, 2019 5:29 PM *To:* Open MPI Users *Subject:* Re: [OMPI users] Building PMIx and Slurm support On Mar 4, 2019, at 5:34 AM, Daniel Letai <mailto:d...@letai.org.il>> wrote: Gilles,

Re: [OMPI users] Building PMIx and Slurm support

2019-03-11 Thread Passant A. Hafez
stain Sent: Monday, March 4, 2019 5:29 PM To: Open MPI Users Subject: Re: [OMPI users] Building PMIx and Slurm support On Mar 4, 2019, at 5:34 AM, Daniel Letai mailto:d...@letai.org.il>> wrote: Gilles, On 3/4/19 8:28 AM, Gilles Gouaillardet wrote: Daniel, On 3/4/2019 3:18 PM, Daniel

Re: [OMPI users] Building PMIx and Slurm support

2019-03-04 Thread Ralph H Castain
> On Mar 4, 2019, at 5:34 AM, Daniel Letai wrote: > > Gilles, > On 3/4/19 8:28 AM, Gilles Gouaillardet wrote: >> Daniel, >> >> >> On 3/4/2019 3:18 PM, Daniel Letai wrote: >>> So unless you have a specific reason not to mix both, you might also give the internal PMIx a try. >>>

Re: [OMPI users] Building PMIx and Slurm support

2019-03-04 Thread Daniel Letai
Gilles, On 3/4/19 8:28 AM, Gilles Gouaillardet wrote: Daniel, On 3/4/2019 3:18 PM, Daniel Letai wrote: So unless you have a specific reason not to mix both, you might also give the internal PMIx a try.

Re: [OMPI users] Building PMIx and Slurm support

2019-03-03 Thread Gilles Gouaillardet
Daniel, On 3/4/2019 3:18 PM, Daniel Letai wrote: So unless you have a specific reason not to mix both, you might also give the internal PMIx a try. Does this hold true for libevent too? Configure complains if libevent for openmpi is different than the one used for the other tools. I am n

Re: [OMPI users] Building PMIx and Slurm support

2019-03-03 Thread Daniel Letai
sers on behalf of Gilles Gouaillardet Sent: Saturday, February 23, 2019 5:17 PM To: Open MPI Users Subject: Re: [OMPI users] Building PMIx and Slurm support Hi,

Re: [OMPI users] Building PMIx and Slurm support

2019-03-03 Thread Gilles Gouaillardet
rday, February 23, 2019 5:17 PM To: Open MPI Users Subject: Re: [OMPI users] Building PMIx and Slurm support Hi, PMIx has cross-version compatibility, so as long as the PMIx library used by SLURM is compatible with the one (internal or external) used by Open MPI, you should be fine. If you want to minimi

Re: [OMPI users] Building PMIx and Slurm support

2019-03-03 Thread Daniel Letai
s for OMPI 4.0.0 installation with configure >> options: >> --with-slurm --with-pmix >> and configure log: >> Libevent support: internal (external libevent version is less that internal >> version 2.0.22) >> PMIx support: Internal >> >> Tested also different installations for 3.1.2 and got errors

Re: [OMPI users] Building PMIx and Slurm support

2019-03-03 Thread Gilles Gouaillardet
ialist > KAUST Supercomputing Core Laboratory (KSL) > King Abdullah University of Science and Technology > Building 1, Al-Khawarizmi, Room 0123 > Mobile : +966 (0) 55-247-9568 > Mobile : +20 (0) 106-146-9644 > Office : +966 (0) 12-808-0367 > >

Re: [OMPI users] Building PMIx and Slurm support

2019-03-03 Thread Bennet Fauber
2.out > (NOT-SUPPORTED in file event/pmix_event_registration.c at line 101) > > > > > > All the best, > -- > Passant A. Hafez | HPC Applications Specialist > KAUST Supercomputing Core Laboratory (KSL) > King Abdullah University of Science and Technology > Building 1,

Re: [OMPI users] Building PMIx and Slurm support

2019-03-03 Thread Andy Riebs
/local/pmix-3.0.2" Andy *From:* Daniel Letai *Sent:* Sunday, March 03, 2019 8:54AM *To:* Users *Cc:* *Subject:* Re: [OMPI users] Building PMIx and Slurm support Hello, I have built the following stack : 1. centos 7.5 (gcc 4.8.5-28, libevent 2.0.21-4) 2. MLNX_OFED_LINUX-4.5-1.0.1.0-rhel7

Re: [OMPI users] Building PMIx and Slurm support

2019-03-03 Thread Daniel Letai
mi, Room 0123 Mobile : +966 (0) 55-247-9568 Mobile : +20 (0) 106-146-9644 Office : +966 (0) 12-808-0367 From: users on behalf of Gilles Gouaillardet Sent: Saturday, February 23, 2019 5:17 PM To: Open MPI Users Subject: Re: [OMPI users] Building P

Re: [OMPI users] Building PMIx and Slurm support

2019-02-28 Thread Jeff Squyres (jsquyres) via users
On Feb 28, 2019, at 12:20 PM, Bennet Fauber wrote: > > I was pointing out why someone might think using `--with-FEATURE=/usr` is > sometimes necessary. True, but only in the case of a bug. :-) ...but in this case, the bug is too old, and we're almost certainly not going to fix it (sorry! :-(

Re: [OMPI users] Building PMIx and Slurm support

2019-02-28 Thread Bennet Fauber
I will see if I get the same thing from the latest OpenMPI -- it will take me a while to fit it in. We're still probably in the 3.x series for prodution, so this is going to have to get done in the margin. Sorry, and thanks for your reply, -- bennet On Thu, Feb 28, 2019 at 12:06 PM Jeff Squyres

Re: [OMPI users] Building PMIx and Slurm support

2019-02-28 Thread Bennet Fauber
Jeff, We could do that, but alas, we have code we need to build against 1.10.7. It looks like what is happening is that opal_hwloc_include is not getting set, but that maybe a test in configure isn't working right, so it populates with a bare '/include/hwloc.h' rather than with either '/usr/inclu

Re: [OMPI users] Building PMIx and Slurm support

2019-02-28 Thread Jeff Squyres (jsquyres) via users
On Feb 28, 2019, at 11:27 AM, Bennet Fauber wrote: > > 13bb410b52becbfa140f5791bd50d580 /sw/src/arcts/ompi/openmpi-1.10.7.tar.gz > bcea63d634d05c0f5a821ce75a1eb2b2 openmpi-v1.10-201705170239-5e373bf.tar.gz Bennet -- I'm sorry; I don't think we've updated the 1.10.x branch in forever. The dat

Re: [OMPI users] Building PMIx and Slurm support

2019-02-28 Thread Bennet Fauber
plying this patch? > > > > > > Another question, is this fix included in the PMIx 2.2.2 > > > https://github.com/pmix/pmix/releases/tag/v2.2.2 ? > > > > > > > > > > > > > > > All the best, > > > &

Re: [OMPI users] Building PMIx and Slurm support

2019-02-24 Thread Bennet Fauber
t; > > > > > > > > All the best, > > > > > > ________ > > From: users on behalf of Gilles > > Gouaillardet > > Sent: Sunday, February 24, 2019 4:09 AM > > To: Open MPI Users > > Subject: Re: [OMPI use

Re: [OMPI users] Building PMIx and Slurm support

2019-02-24 Thread Passant A. Hafez
Office : +966 (0) 12-808-0367 From: users on behalf of Gilles Gouaillardet Sent: Sunday, February 24, 2019 1:19 PM To: Open MPI Users Subject: Re: [OMPI users] Building PMIx and Slurm support Passant, The fix is included in PMIx 2.2.2 The bug is in a

Re: [OMPI users] Building PMIx and Slurm support

2019-02-24 Thread Gilles Gouaillardet
101) > > > > > > > > > > > > All the best, > > -- > > Passant A. Hafez | HPC Applications Specialist > > KAUST Supercomputing Core Laboratory (KSL) > > King Abdullah University of Science and Technology > > Building 1, Al-Khawar

Re: [OMPI users] Building PMIx and Slurm support

2019-02-23 Thread Passant A. Hafez
: Sunday, February 24, 2019 4:09 AM To: Open MPI Users Subject: Re: [OMPI users] Building PMIx and Slurm support Passant, you have to manually download and apply https://github.com/pmix/pmix/commit/2e2f4445b45eac5a3fcbd409c81efe318876e659.patch to PMIx 2.2.1 that should likely fix your problem. As

Re: [OMPI users] Building PMIx and Slurm support

2019-02-23 Thread Gilles Gouaillardet
ore Laboratory (KSL) > King Abdullah University of Science and Technology > Building 1, Al-Khawarizmi, Room 0123 > Mobile : +966 (0) 55-247-9568 > Mobile : +20 (0) 106-146-9644 > Office : +966 (0) 12-808-0367 > > ________________ > From: users on

Re: [OMPI users] Building PMIx and Slurm support

2019-02-23 Thread Passant A. Hafez
:17 PM To: Open MPI Users Subject: Re: [OMPI users] Building PMIx and Slurm support Hi, PMIx has cross-version compatibility, so as long as the PMIx library used by SLURM is compatible with the one (internal or external) used by Open MPI, you should be fine. If you want to minimize the risk of cross

Re: [OMPI users] Building PMIx and Slurm support

2019-02-23 Thread Gilles Gouaillardet
Hi, PMIx has cross-version compatibility, so as long as the PMIx library used by SLURM is compatible with the one (internal or external) used by Open MPI, you should be fine. If you want to minimize the risk of cross-version incompatibility, then I encourage you to use the same (and hence external

[OMPI users] Building PMIx and Slurm support

2019-02-23 Thread Passant A. Hafez
Good day everyone, I've trying to build and use the PMIx support for Open MPI but I tried many things that I can list if needed, but with no luck. I was able to test the PMIx client but when I used OMPI specifying srun --mpi=pmix it didn't work. So if you please advise me with the versions of