Thanks Rolf. 

Sent from my iPhone

> On Sep 5, 2014, at 6:28 PM, Rolf vandeVaart <rvandeva...@nvidia.com> wrote:
> 
> Yes, I have reproduced.  And I agree with your thoughts on configuring vs 
> runtime error.  I will look into this.
> Thanks,
> Rolf
> 
>> -----Original Message-----
>> From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Brock Palen
>> Sent: Friday, September 05, 2014 5:22 PM
>> To: Open MPI Users
>> Subject: [OMPI users] enable-cuda with disable-dlopen
>> 
>> * PGP Signed by an unknown key
>> 
>> We found with 1.8.[1,2]  that is you compile with
>> 
>> --with-mxm
>> --with-cuda
>> --disable-dlopen
>> 
>> OMPI will compile install and run, but if you run disabling mxm (say to debug
>> something)
>> 
>> mpirun --mca mtl ^mxm ./a.out
>> 
>> You will get a notice saying that you cannot have enable cuda with disable
>> dlopen, and the job dies.
>> 
>> Is there any reason this shouldn't be a configure time error?  Rather than a
>> runtime error?
>> 
>> Note we have moved to --disable-mca-dso to get the result we want (less
>> iops to the server hosting the install)
>> 
>> Our full configure was:
>> 
>> PREFIX=/home/software/rhel6/openmpi-1.8.2/gcc-4.8.0
>> MXM=/opt/mellanox/mxm
>> FCA=/opt/mellanox/fca
>> KNEM=/opt/knem-1.1.1.90mlnx
>> CUDA=/home/software/rhel6/cuda/5.5/cuda
>> COMPILERS='CC=gcc CXX=g++ FC=gfortran'
>> ./configure \
>> --prefix=$PREFIX \
>> --mandir=${PREFIX}/man \
>> --disable-dlopen \
>> --enable-shared \
>> --enable-java   \
>> --enable-mpi-java \
>> --with-cuda=$CUDA \
>> --with-hwloc=internal \
>> --with-verbs \
>> --with-psm   \
>> --with-tm=/usr/local/torque \
>> --with-fca=$FCA \
>> --with-mxm=$MXM \
>> --with-knem=$KNEM \
>> --with-io-romio-flags='--with-file-system=testfs+ufs+nfs+lustre' \
>>  $COMPILERS
>> 
>> Brock Palen
>> www.umich.edu/~brockp
>> CAEN Advanced Computing
>> XSEDE Campus Champion
>> bro...@umich.edu
>> (734)936-1985
>> 
>> 
>> 
>> 
>> * Unknown Key
>> * 0x806FCF94
> -----------------------------------------------------------------------------------
> This email message is for the sole use of the intended recipient(s) and may 
> contain
> confidential information.  Any unauthorized review, use, disclosure or 
> distribution
> is prohibited.  If you are not the intended recipient, please contact the 
> sender by
> reply email and destroy all copies of the original message.
> -----------------------------------------------------------------------------------
> _______________________________________________
> users mailing list
> us...@open-mpi.org
> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users
> Link to this post: 
> http://www.open-mpi.org/community/lists/users/2014/09/25283.php

Reply via email to