Re: [OMPI users] OpenMPI 4.0.6 w/GCC 8.5 on CentOS 7.9; "WARNING: There was an error initializing an OpenFabrics device."

2021-07-29 Thread Sergey Oblomov via users
Hi This issue arrives from BTL OpenIB, not related to UCX From: users on behalf of Ryan Novosielski via users Date: Thursday, 29 July 2021, 08:25 To: users@lists.open-mpi.org Cc: Ryan Novosielski Subject: [OMPI users] OpenMPI 4.0.6 w/GCC 8.5 on CentOS 7.9; "WARNING: There was an error initi

Re: [OMPI users] OpenMPI 4.0.6 w/GCC 8.5 on CentOS 7.9; "WARNING: There was an error initializing an OpenFabrics device."

2021-07-29 Thread Ralph Castain via users
Ryan - I suspect what Sergey was trying to say was that you need to ensure OMPI doesn't try to use the OpenIB driver, or at least that it doesn't attempt to initialize it. Try adding OMPI_MCA_pml=ucx to your environment. On Jul 29, 2021, at 1:56 AM, Sergey Oblomov via users mailto:users@lists

Re: [OMPI users] OpenMPI 4.0.6 w/GCC 8.5 on CentOS 7.9; "WARNING: There was an error initializing an OpenFabrics device."

2021-07-29 Thread Ryan Novosielski via users
Thanks, Ralph. This /does/ change things, but not very much. I was not under the impression that I needed to do that, since when I ran without having built against UCX, it warned me about the openib method being deprecated. By default, does OpenMPI not use either anymore, and I need to specifica

Re: [OMPI users] OpenMPI 4.0.6 w/GCC 8.5 on CentOS 7.9; "WARNING: There was an error initializing an OpenFabrics device."

2021-07-29 Thread Ralph Castain via users
So it _is_ UCX that is the problem! Try using OMPI_MCA_pml=ob1 instead > On Jul 29, 2021, at 8:33 AM, Ryan Novosielski wrote: > > Thanks, Ralph. This /does/ change things, but not very much. I was not under > the impression that I needed to do that, since when I ran without having > built ag