Re: [OMPI users] Bug in Fortran-module MPI of OpenMPI 1.10.0 with Intel-Ftn-compiler

2015-11-24 Thread Ralph Castain
Hi Jeff I believe you misunderstood my comment. My point was that everyone optimizes their distributions according to different rules based on a variety of factors. Intel MPI targets a specific market segment that allows them to set all those nice little parameters such as eager limit to someth

Re: [OMPI users] Bug in Fortran-module MPI of OpenMPI 1.10.0 with Intel-Ftn-compiler

2015-11-24 Thread Jeff Hammond
Ralph: Intel MPI supports a wide range of conduits in the same library ( https://software.intel.com/sites/default/files/Reference_Manual_1.pdf, section 3.3.1), which can be selected at runtime, so I don't understand your specialization argument. Are you suggesting that a lack of CPU-specific opti

Re: [OMPI users] OpenMPI with infiniband, child processes of mpirun are missing or overlapped on the same cpu

2015-11-24 Thread Dave Love
"김건홍(KIM GEON HONG)" writes: > Another interesting symptom is that, > if I run two mpirun’s with –np 2 option on a same node, those two > mpirun’s run on the same cpu’s. I thought OMPI avoided doing that, but anyway you really should use a resource manager to control the allocation. (I mean mana

Re: [OMPI users] OpenMPI with infiniband, child processes of mpirun are missing or overlapped on the same cpu

2015-11-24 Thread Dave Love
"김건홍(KIM GEON HONG)" writes: > Hello, > > I tried to run a parallel computation (OpenFOAM) using Open MPI on a > HPC connected with infiniband. > When I ran a job using mpirun over a couple of nodes (20 cpus per > node), the computation was not accelerated as I expected. The usual problem with Op

Re: [OMPI users] help understand unhelpful ORTE error message

2015-11-24 Thread Dave Love
Gilles Gouaillardet writes: > Currently, ompi create a file in the temporary directory and then mmap it. > an obvious requirement is the temporary directory must have enough free > space for that file. > (this might be an issue on some disk less nodes) > > > a simple alternative could be to try /

Re: [OMPI users] OpenMPI with infiniband, child processes of mpirun are missing or overlapped on the same cpu

2015-11-24 Thread Aurélien Bouteiller
Not by default. It can be done with a rankfile, but the observed behavior is normal when launching two mpirun with the same machinefile and all default options. Aurélien -- Aurélien Bouteiller, Ph.D. ~~ https://icl.cs.utk.edu/~bouteill/ > Le 24 nov. 2015 à

Re: [OMPI users] OpenMPI with infiniband, child processes of mpirun are missing or overlapped on the same cpu

2015-11-24 Thread Gilles Gouaillardet
are two mpirun supposed to talk to each other in order to avoid binding to the same cpu/socket/... twice ? On 11/24/2015 4:46 PM, Aurélien Bouteiller wrote: You can use the 'mpirun -report-bindings’ option to see how your processes have been mapped in your deployment. If you are unhappy with

Re: [OMPI users] OpenMPI with infiniband, child processes of mpirun are missing or overlapped on the same cpu

2015-11-24 Thread Aurélien Bouteiller
You can use the 'mpirun -report-bindings’ option to see how your processes have been mapped in your deployment. If you are unhappy with the default, you can play with the -map-by option. Aurélien -- Aurélien Bouteiller, Ph.D. ~~ https://icl.cs.utk.edu/~bouteill/

Re: [OMPI users] OpenMPI with infiniband, child processes of mpirun are missing or overlapped on the same cpu

2015-11-24 Thread KIM GEON HONG
I use Open MPI 1.8.5. The command is as following: $ mpirun –np 40 –hostfile machines simpleFoam –parallel and the host file “machines” says, hpcnode127 cpu=20 hpcnode128 cpu=20 Another interesting symptom is that, if I run two mpirun’s with –np 2 option on a same node, those two mpirun’s run on

Re: [OMPI users] OpenMPI with infiniband, child processes of mpirun are missing or overlapped on the same cpu

2015-11-24 Thread Ralph Castain
Could you please tell us what version of OpenMPI you are using, and the cmd line you used to execute the job? Thanks Ralph > On Nov 23, 2015, at 11:05 PM, 김건홍(KIM GEON HONG) > wrote: > > Hello, > > I tried to run a parallel computation (OpenFOAM) using Open MPI on a HPC > connected with in

[OMPI users] OpenMPI with infiniband, child processes of mpirun are missing or overlapped on the same cpu

2015-11-24 Thread KIM GEON HONG
Hello, I tried to run a parallel computation (OpenFOAM) using Open MPI on a HPC connected with infiniband. When I ran a job using mpirun over a couple of nodes (20 cpus per node), the computation was not accelerated as I expected. For example, I ran the job over 40 cpus on 2 nodes, and I checke