After looking into this a bit more it appears that the issue is I am building
on a head node which does not have the driver installed. Building on back node
resolves this issue. In CUDA 8.0 the NVML stubs can be found in the toolkit at
the following path: ${CUDA_HOME}/lib64/stubs
For 8.0 I'd suggest updating the configure/make scripts to look for nvml there
and link in the stubs. This way the build is not dependent on the driver being
installed and only the toolkit.
Thanks,
Justin
From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Justin
Luitjens
Sent: Tuesday, October 18, 2016 9:53 AM
To: users@lists.open-mpi.org
Subject: [OMPI users] Problem building OpenMPI with CUDA 8.0
I have the release version of CUDA 8.0 installed and am trying to build OpenMPI.
Here is my configure and build line:
./configure --prefix=$PREFIXPATH --with-cuda=$CUDA_HOME --with-tm=
--with-openib= && make && sudo make install
Where CUDA_HOME points to the cuda install path.
When I run the above command it builds for quite a while but eventually errors
out wit this:
make[2]: Entering directory
`/home/jluitjens/Perforce/jluitjens_dtlogin_p4sw/sw/devrel/DevtechCompute/Internal/Tools/dtlogin/scripts/mpi/openmpi-1.10.1-gcc5.0_2014_11-cuda8.0/opal/tools/wrappers'
CCLD opal_wrapper
../../../opal/.libs/libopen-pal.so: undefined reference to `nvmlInit_v2'
../../../opal/.libs/libopen-pal.so: undefined reference to
`nvmlDeviceGetHandleByIndex_v2'
../../../opal/.libs/libopen-pal.so: undefined reference to
`nvmlDeviceGetCount_v2'
Any idea what I might need to change to get around this error?
Thanks,
Justin
________________________________
This email message is for the sole use of the intended recipient(s) and may
contain confidential information. Any unauthorized review, use, disclosure or
distribution is prohibited. If you are not the intended recipient, please
contact the sender by reply email and destroy all copies of the original
message.
________________________________
_______________________________________________
users mailing list
users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
