[OMPI users] [ompi-1.4.1] compiling without openib, running with openib + ompi141 and gcc3

[Mathieu Gontier]

Hello, I built OpenMPI-1.4.1 without openib support with the following configuration options: ./configure --prefix=/develop/libs/OpenMPI/openmpi-1.4.1/LINUX_GCC_4_1_tcp_mach --enable-static --enable-shared --enable-cxx-exceptions --enable-mpi-f77 --disable-mpi-f90 --enable-mpi-cxx --disable-mpi-cxx-seek --enable-dist --enable-mpi-profile --enable-binaries --enable-mpi-threads --enable-memchecker --disable-debug --with-pic --with-threads   --with-sge On my cluster, I run a small test (a broadcast on a 100 integer array) on 12 processes balanced on 3 nodes, but I asked for using openib. It works with the following messages: mpirun -np 12 -hostfile /tmp/72936.1.64.q/machines --mca btl openib,sm,self /home/numeca/tmp/gontier/bcast/exe_ompi_cluster -nloop 2 -nbuff 100 libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.     This will severely limit memory registrations. libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.     This will severely limit memory registrations. -------------------------------------------------------------------------- WARNING: There was an error initializing an OpenFabrics device.   Local host:   node005   Local device: mthca0 -------------------------------------------------------------------------- libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.     This will severely limit memory registrations. libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.     This will severely limit memory registrations. libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.     This will severely limit memory registrations. libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.     This will severely limit memory registrations. libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.     This will severely limit memory registrations. libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.     This will severely limit memory registrations. libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.     This will severely limit memory registrations. libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.     This will severely limit memory registrations. libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.     This will severely limit memory registrations. libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.     This will severely limit memory registrations. processing... done [node005:04791] 11 more processes have sent help message help-mpi-btl-openib.txt / error in device init [node005:04791] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages I finally run ompi_info: ./ompi_info | grep openib                  MCA btl: openib (MCA v2.0, API v2.0, Component v1.4.1) Openib seems to be supported. That is weird because I did not ask for... So, assuming the compilation of OpenMPI which does not support openib here, what happened? Was tcp selected? How can I check which device has been used (or force an explicit message)? By the way, what is the meaning of this message in my case? By the way, another different think: does OpenMPI must be compiled with gcc-4.1 or later, or gcc-3.4 (for example) can be used? Thank you for your help, Mathieu.