Jeff,
Here is the result of the "pbs-config". By the way, I have successfully
built OpenMPI 1.2.4 on this same system. The "config.log" for OpenMPI 1.2.4
shows the correct Torque path. That is not surprising since the "configure"
script for OpenMPI 1.2.4 uses "pbs-config" while the configure script for
OpenMPI 1.2 does not.
--------------------------------------------------------------------------------------------------------------------
# pbs-config --libs
-L/usr/local/pbs/x86_64/lib -ltorque -Wl,--rpath
-Wl,/usr/local/pbs/x86_64/lib
--------------------------------------------------------------------------------------------------------------------
Now, to address your concern about the nodes, my users are not "adding
nodes" to those provided by Torque. They are using a "proper subset" of the
nodes. Also, I believe I read this comment on the OpenMPI web site which
seems to imply an oversight as far as the "-hostfile" is concerned.
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Can I specify a hostfile or use the --host option to mpirun when running in
a Torque / PBS environment?
As of version v1.2.1, no.
Open MPI will fail to launch processes properly when a hostfile is specifed
on the mpirun command line, or if the mpirun [--host] option is used.
We're working on correcting the error. A future version of Open MPI will
likely launch on the hosts specified either in the hostfile or via the
--host option as long as they are a proper subset of the hosts allocated to
the Torque / PBS Pro job.
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Thanks,
J.W. (Pat) O'Bryant,Jr.
Business Line Infrastructure
Technical Systems, HPC
Office: 713-431-7022
