Sorry, my mailer incorrectly classified this message as spam (gotta
love Outlook!) and I didn't see this message until today.
On May 12, 2008, at 5:24 AM, Karolis Eigelis wrote:
ello,
I have Rocks 4.3 installed. Frontend 32bit and nodes with 64bit.
Traying to run openmpi with torque support using multilib.
/usr/local shared among nodes
CONFIGURING and INSTALL
[from frontend 32bit]
./configure --with-tm=/opt/torque/ --prefix=/usr/local/openmpi-1.2.6
--
includedir='${prefix}/include/32' --libdir='${prefix}/lib32' && make
&& make install && make check
/usr/local/openmpi-1.2.6/bin/ompi_info |grep tm
MCA memory: ptmalloc2 (MCA v1.0, API v1.0, Component
v1.2.6)
MCA ras: tm (MCA v1.0, API v1.3, Component v1.2.6)
MCA pls: tm (MCA v1.0, API v1.3, Component v1.2.6)
[form node 64bit]
./configure --disable-binaries --with-tm=/opt/torque/ --prefix=/usr/
local/openmpi-1.2.6 --includedir='${prefix}/include/64' --libdir='$
{prefix}/lib64' && make && make install && make check
Note OMPI doesn't directly support being installed this way -- you
effectively replaced your 32 bit build with a 64 bit build because
the /usr/local/openmpi-1.2.6/bin/<ompi_tools> will be looking in the
64 bit directories for their support. I don't think you'll get what
you want this way (both a 32 and 64 bit build).
Maybe one of the Sun guys can chime in here -- they make 32+64 bit Sun
builds with a little trickery after the build (e.g., frob our wrapper
compiler scripts, etc.)...
But a better / easier solution would be just to have 2 different
installs for OMPI. Or just abandon the 32 bit version (unless you
really, really need it). In a perfect world, "mpicc -32 ..." (or
something like that) would Just Work. But we honestly haven't had
enough demand from users to spend the time to make it so for general /
community Linux builds.
/usr/local/openmpi-1.2.6/bin/ompi_info |grep tm
[compute-0-16.local:18284] mca: base: component_find: unable to open
ras tm: file not found (ignored)
[compute-0-16.local:18284] mca: base: component_find: unable to open
pls tm: file not found (ignored)
MCA memory: ptmalloc2 (MCA v1.0, API v1.0, Component
v1.2.6)
It's likely that you don't have the torque support library installed
on the back-end ROCKS nodes.
There could be some 32/64 funkyness going on here with your install
form above, but the lack of libtm on the compute nodes is the first
thing I'd check.
--
Jeff Squyres
Cisco Systems
