No there would be no overlap. We run a large legacy condo, with several islands of Infiniband of different ages and types. Users run within their condo/ib island. So PSM users only run on PSM nodes they own, and there is no overlap.
Our jobs range from 4 cores to 1000 cores, looking at the FAQ page it states that MXM was used in the past only for >128 ranks, but is in 1.6 used for rank counts of any size. I think we will do some testing, we never even heard of MXM before, Brock Palen www.umich.edu/~brockp CAEN Advanced Computing bro...@umich.edu (734)936-1985 On Jan 22, 2013, at 2:58 PM, Shamis, Pavel wrote: >> We just learned about MXM, and given most our cards are Mellonox ConnectX >> cards (though not all, have have islands of previous to ConnectX and Qlogic >> supported in the same OpenMPI environment), >> >> Will MXM correctly fail though to PSM if on qlogic gear and fail though to >> OpenIB if on previous to connectX cards? > > Do you want to run MXM and PSM in the same MPI session ? You can't do it. MXM > and PSM use different network protocols. > If you want to use MXM in your MPI job, all nodes should be configured to use > MXM. > > On the other hand, OpenIB btl should support mixed environments out of the > box. > > - Pasha > _______________________________________________ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users
