Re: [OMPI users] How to verify RDMA traffic (RoCE) is being sent over a fabric when running OpenMPI

HI Brenda, I should clarify as my response may confuse folks. We had configured the connectx4 cards to use ethernet/RoCE rather than IB transport for these measurements. Howard 2016-11-08 16:08 GMT-07:00 Howard Pritchard : > Hi Brenda, > > What type of ethernet device (is this a Mellanox HCA?

Re: [OMPI users] How to verify RDMA traffic (RoCE) is being sent over a fabric when running OpenMPI

Hi Brenda, What type of ethernet device (is this a Mellanox HCA?) and ethernet switch are you using? The mpirun configure options look correct to me. Is it possible that you have all the mpi processes on a single node? It should be pretty obvious from the SendRecv IMB test if you're using RoCE.

[OMPI users] How to verify RDMA traffic (RoCE) is being sent over a fabric when running OpenMPI

Hello, I am trying to figure out how I can verify that the OpenMPI traffic is actually being transmitted over my RoCE fabric connecting my cluster. My MPI job runs quickly and error free but I cannot seem to verify that significant amounts of data is being transferred to the other endpoint in my