Re: [OMPI users] Problem building OpenMPI with CUDA 8.0

2016-10-24 Thread Gilles Gouaillardet
Brice, unless you want to enable/disable nvml at runtime, and assuming we do not need nvml in Open MPI, and IMHO, the easiest workaround is to update https://github.com/open-mpi/ompi/blob/master/opal/mca/hwloc/hwloc1113/configure.m4 and add the oneliner enable_nvml=no a better option cou

Re: [OMPI users] Problem building OpenMPI with CUDA 8.0

2016-10-24 Thread Brice Goglin
FWIW, I am still open to implementing something to workaround this in hwloc. Could be shell variable such as HWLOC_DISABLE_NVML=yes for all our major configured dependencies. Brice Le 24/10/2016 02:12, Gilles Gouaillardet a écrit : > Justin, > > > iirc, NVML is only used by hwloc (e.g. not by C

Re: [OMPI users] Problem building OpenMPI with CUDA 8.0

2016-10-23 Thread Gilles Gouaillardet
Justin, iirc, NVML is only used by hwloc (e.g. not by CUDA) and there is no real benefit for having that. as a workaround, you can export enable_nvml=no and then configure && make install Cheers, Gilles On 10/20/2016 12:49 AM, Jeff Squyres (jsquyres) wrote: Justin -- Fair point. Can y

Re: [OMPI users] Problem building OpenMPI with CUDA 8.0

2016-10-19 Thread Jeff Squyres (jsquyres)
Justin -- Fair point. Can you work with Sylvain Jeaugey (at Nvidia) to submit a pull request for this functionality? Thanks. > On Oct 18, 2016, at 2:26 PM, Justin Luitjens wrote: > > After looking into this a bit more it appears that the issue is I am building > on a head node which does n

Re: [OMPI users] Problem building OpenMPI with CUDA 8.0

2016-10-18 Thread Justin Luitjens
After looking into this a bit more it appears that the issue is I am building on a head node which does not have the driver installed. Building on back node resolves this issue. In CUDA 8.0 the NVML stubs can be found in the toolkit at the following path: ${CUDA_HOME}/lib64/stubs For 8.0 I'd