Howdy, I'm new to cluster administration, MPI and high speed networks. I've compiled my OpenMPI using these settings:
./configure CC='icc' CXX='icpc' FC='ifort' F77='ifort' --with-mvapi=/usr/local/topspin --with-mvapi-libdir=/usr/local/topspin/lib64 --enable-static --prefix=/share/apps/openmpi/1.1.2 I'm running a Gromacs -np 16 job that I submitting using Sun Grid Engine and OpenMPI that's going to run for several hours. The job was submitted with: mpirun -np 16 -machinefile machines mdrun ...... I've been asked by the owner of the cluster "How can you prove to me that this openmpi job is using the Infiniband network?" At first I thought a simple netstat -an on the compute nodes might tell me, however I don't see the Infiniband IP's in the list so I'm thinking maybe I need to be looking elsewhere. Ompi_info reports: MCA mpool: mvapi (MCA v1.0, API v1.0, Component v1.1.2) MCA btl: mvapi (MCA v1.0, API v1.0, Component v1.1.2) Thanks for any suggestions, Mike