Re: [OMPI users] I can't build openmpi 4.0.X using PMIx 3.1.5 to use with Slurm

2020-05-11 Thread Gilles Gouaillardet via users
Leandro, First you must make sure SLURM has been built with PMIx (preferably PMIx 3.1.5) and the pmix plugin was built. >From the Open MPI point of view, you do not need the --with-ompi-pmix-rte option. If you want to uses srun, just make sure it uses pmix. you can srun --mpi=list If you want t

Re: [OMPI users] I can't build openmpi 4.0.X using PMIx 3.1.5 to use with Slurm

2020-05-11 Thread Leandro via users
Well, I have to build these packages because of specific compilers and some options the developers need. I do this for years, Always worked fine. But, nowadays I am using torque and maui on the clusters, and theses are giving me problems now. The openmpi we use now, with torque, is built using a c

Re: [OMPI users] I can't build openmpi 4.0.X using PMIx 3.1.5 to use with Slurm

2020-05-11 Thread Ralph Castain via users
I'm not sure I understand why you are trying to build CentOS rpms for PMIx, Slurm, or OMPI - all three are readily available online. Is there some particular reason you are trying to do this yourself? I ask because it is non-trivial to do and requires significant familiarity with both the intri

Re: [OMPI users] [External] Re: can't open /dev/ipath, network down (err=26)

2020-05-11 Thread Prentice Bisbal via users
Thanks. I'm going to give this solution a try. On 5/9/20 9:51 AM, Patrick Bégou via users wrote: Le 08/05/2020 à 21:56, Prentice Bisbal via users a écrit : We often get the following errors when more than one job runs on the same compute node. We are using Slurm with OpenMPI. The IB cards are

Re: [OMPI users] [External] can't open /dev/ipath, network down (err=26)

2020-05-11 Thread Prentice Bisbal via users
I believe they're DDR cards. On 5/9/20 6:36 AM, Heinz, Michael William via users wrote: Prentice, Avoiding the obvious question of whether your FM is running and the fabric is in an active state, It sounds like your exhausting a resource on the cards. Ralph is correct about support for QLogic

[OMPI users] I can't build openmpi 4.0.X using PMIx 3.1.5 to use with Slurm

2020-05-11 Thread Leandro via users
Hi, I'm trying to start using Slurm, and I followed all the instructions ti build PMIx, Slurm using pmix, but I can't make openmpi to work. According to PMIx documentation, I should compile openmpi using "--with-ompi-pmix-rte" but when I tried, It fails. I need to build this as CentOS rpms. Than