[OMPI users] GPUDirect with OpenMPI

2015-02-11 Thread Aulwes, Rob
Hi, I built OpenMPI 1.8.3 using PGI 14.7 and enabled CUDA support for CUDA 6.0. I have a Fortran test code that tests GPUDirect and have included it here. When I run it across 2 nodes using 4 MPI procs, sometimes it fails with incorrect results. Specifically, sometimes rank 1 does not receiv

Re: [OMPI users] GPUDirect with OpenMPI

2015-03-09 Thread Aulwes, Rob
Direct RDMA. However, to eliminate it, you could run with: --mca btl_openib_want_cuda_gdr 0. Rolf From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Aulwes, Rob Sent: Wednesday, February 11, 2015 2:17 PM To: us...@open-mpi.org<mailto:us...@open-mpi.org> Subject: [OMPI users] G