Re: [OMPI users] CUDA-aware codes not using GPU

2019-09-06 Thread AFernandez via users
Hi Akshay, I'm building both UCX and OpenMPI as you mention. The portions of the script read: ./configure --prefix=/usr/local/ucx-cuda-install --with-cuda=/usr/local/cuda-10.1 --with-gdrcopy=/home/odyhpc/gdrcopy --disable-numa sudo make install & ./configure --with-cuda=/usr/local/cuda-10.

[OMPI users] Floating point overflow and tuning

2019-09-06 Thread Logan Stonebraker via users
I am working with star ccm+ 2019.1.1 Build 14.02.012 CentOS 7.6 kernel 3.10.0-957.21.3.el7.x86_64 Intel MPI Version 2018 Update 5 Build 20190404 (this is version shipped with star ccm+) Also trying to make openmpi work (more on that later) Cisco UCS b200 and c240 cluster using USNIC fabric over 10

Re: [OMPI users] CUDA-aware codes not using GPU

2019-09-06 Thread Akshay Venkatesh via users
Hi, Arturo. Usually, for OpenMPI+UCX we use the following recipe for UCX: ./configure --prefix=/path/to/ucx-cuda-install --with-cuda=/usr/local/cuda --with-gdrcopy=/usr make -j install then OpenMPI: ./configure --with-cuda=/usr/local/cuda --with-ucx=/path/to/ucx-cuda-install make -j insta

Re: [OMPI users] UCX and MPI_THREAD_MULTIPLE

2019-09-06 Thread Paul Edmon via users
As a coda to this I managed to get UCX 1.6.0 built with threading and OpenMPI 4.0.1 to build using this: https://github.com/openucx/ucx/issues/4020 That appears to be working. -Paul Edmon- On 8/26/19 9:20 PM, Joshua Ladd wrote: **aproposĀ  :-) On Mon, Aug 26, 2019 at 9:19 PM Joshua Ladd

Re: [OMPI users] CUDA-aware codes not using GPU

2019-09-06 Thread Arturo Fernandez via users
<<< text/html: Unrecognized >>> ___ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users

Re: [OMPI users] CUDA-aware codes not using GPU

2019-09-06 Thread Joshua Ladd via users
Did you build UCX with CUDA support (--with-cuda) ? Josh On Thu, Sep 5, 2019 at 8:45 PM AFernandez via users < users@lists.open-mpi.org> wrote: > Hello OpenMPI Team, > > I'm trying to use CUDA-aware OpenMPI but the system simply ignores the GPU > and the code runs on the CPUs. I've tried differe