Re: [OMPI users] Multithreading applications with OMPI 1.7

2012-04-27 Thread Ralph Castain
On Apr 27, 2012, at 5:20 PM, Jens Glaser wrote: > Hi, > > we've tried to use a multithreaded application with a more recent trunk > version (March 21) of OpenMPI. We need to use this version because of CUDA > RDMA support. OpenMPI was binding all the threads to a single core, which is > undes

[OMPI users] Multithreading applications with OMPI 1.7

2012-04-27 Thread Jens Glaser
Hi, we've tried to use a multithreaded application with a more recent trunk version (March 21) of OpenMPI. We need to use this version because of CUDA RDMA support. OpenMPI was binding all the threads to a single core, which is undesirable. In OpenMPI 1.5. there was an option --cpus-per-rank, w

Re: [OMPI users] Error with multiple MPI runs inside one Slurm allocation (with QLogic PSM)

2012-04-27 Thread Ralph Castain
Couple of things: 1. please do send the output from ompi_info 2. please send the slurm envars from your allocation - i.e., after you do your salloc. Are you sure that slurm is actually "binding" us during this launch? If you just srun your get-allowed-cpu, what does it show? I'm wondering if i

Re: [OMPI users] Error with multiple MPI runs inside one Slurm allocation (with QLogic PSM)

2012-04-27 Thread Rémi Palancher
Hi there, First, thank you for all your helpful answers! On Mon, 2 Apr 2012 20:30:37 -0700, Ralph Castain wrote: I'm afraid the 1.5 series doesn't offer any help in this regard. The required changes only exist in the developers trunk, which will be released as the 1.7 series in the not-too-di