Re: [OMPI users] mpirun and Torque

2016-06-07 Thread Ralph Castain
I can confirm that mpirun will not direct-launch the applications under Torque. This is done for wireup support - if/when Torque natively supports PMIx, then we could revisit that design. Gilles: the benefit is two-fold: * Torque has direct visibility of the application procs. When we launch vi

Re: [OMPI users] mpirun and Torque

2016-06-07 Thread Gilles Gouaillardet
Ken, iirc, and under torque when Open MPI is configure'd with --with -tm (this is the default, so assuming your torque headers/libs can be found, you do not even have to specify --with-tm), mpirun does tm_spawn the orted daemon on all nodes except the current one. then mpirun and orted will

[OMPI users] mpirun and Torque

2016-06-07 Thread Ken Nielson
I am using openmpi version 1.10.2 with Torque 6.0.1. I launch a job with the following syntax: qsub -L tasks=2:lprocs=2:maxtpn=1 -I This starts an interactive job which is using two nodes. I then use mpirun as follows from the command line of the interactive job. mpirun -np 4 sleep 6