Hi Michael, >From what I understand, this is an issue with the qib driver and PSM from RHEL >6.5 and 6.6, and will be fixed for 6.7. There is no functional change between >qib->PSM API versions 11 and 12, so the message is harmless. I presume you're >using the RHEL sourced package for a reason, but using an IFS release would >fix the problem until RHEL 6.7 is ready.
Andrew > -----Original Message----- > From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Michael Di > Domenico > Sent: Tuesday, November 4, 2014 8:35 AM > To: Open MPI Users > Subject: [OMPI users] ipath_userinit errors > > I'm getting the below message on my cluster(s). It seems to only happen > when I try to use more then 64 nodes (16-cores each). The clusters are > running RHEL 6.5 with Slurm and Openmpi-1.6.5 with PSM. > I'm using the OFED versions included with RHEL for infiniband support. > > ipath_userinit: Mismatched user minor version (12) and driver minor version > (11) while context sharing. Ensure that driver and library are from the same > release > > I already realize this is a warning message and the jobs complete. > Another user a little over a year ago had a similar issue that was tracked to > mismatched ofed versions. Since i have a diskless cluster all my nodes are > identical. > > I'm not adverse to thinking there might not be something unique about my > machine, but since i have two separate machines doing it, I'm not really sure > where to look to triage the issue and see what might be set incorrectly. > > Any thoughts on where to start checking would be helpful, thanks... > _______________________________________________ > users mailing list > us...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > Link to this post: http://www.open- > mpi.org/community/lists/users/2014/11/25667.php