Hi, I'm submitting a job through torque/PBS, the head node also runs the Moab scheduler, the .pbs file has this in the resources line :
#PBS -l nodes=2:ppn=4 I've also tried something like : #PBS -l procs=56 and at the end of script I'm running : mpirun -np 8 cat /dev/urandom > /dev/null or mpirun -np 56 cat /dev/urandom > /dev/null ...depending on how many processors I requested. The job starts, $PBS_NODEFILE has the nodes that the job was assigned listed, but all the cat's are piled onto the first node. Any idea how I can get this to submit jobs across multiple nodes? Note, I have OSU mpiexec working without problems with mvapich and mpich2 on our cluster to launch jobs across multiple nodes. Thanks, Sabuj