Re: [OMPI users] Running a hybrid MPI+openMP program

Hi Reuti and Ralph, How do you think if we accept bind-to none option even when the pe=N option is provided? just like: mpirun -map-by slot:pe=N -bind-to none ./inverse If yes, it's easy for me to make a patch. Tetsuya Tetsuya Mishima tmish...@jcity.maeda.co.jp

Re: [OMPI users] Running a hybrid MPI+openMP program

e with 14 machines, each one with 16 cores. The >> > > > > > >> program divides the work among the 14 processors with MPI and within each processor a loop is also divided into 8 threads for example, using openmp. The problem is that when I submit the job to the queue the MPI processes don't divide the work into threads and the program prints the number of threads that are working within each process as one. >> > > > > > >> >> > > > > > >> I made a simple test program that uses openmp and I logged in >> > > > > > >> one machine of the fourteen. I compiled it using gfortran >> > > > > > >> -fopenmp program.f -o exe, set the OMP_NUM_THREADS environment variable equal to 8 and when I ran directly in the terminal the loop was effectively divided among the cores and for example in this case the program printed the number of threads equal to 8 >> > > > > > >> >> > > > > > >> This is my Makefile >> > > > > > >> >> > > > > > >> # Start of the makefile >> > > > > > >> # Defining variables >> > > > > > >> objects = inv_grav3d.o funcpdf.o gr3dprm.o fdjac.o dsvd.o >> > > > > > >> #f90comp = /opt/openmpi/bin/mpif90 >> > > > > > >> f90comp = /usr/bin/mpif90 >> > > > > > >> #switch = -O3 >> > > > > > >> executable = inverse.exe >> > > > > > >> # Makefile >> > > > > > >> all : $(executable) >> > > > > > >> $(executable) : $(objects) >> > > > > > >> $(f90comp) -fopenmp -g -O -o $(executable) $(objects) >> > > > > > >> rm $(objects) >> > > > > > >> %.o: %.f >> > > > > > >> $(f90comp) -c $< >> > > > > > >> # Cleaning everything >> > > > > > >> clean: >> > > > > > >> rm $(executable) >> > > > > > >> # rm $(objects) >> > > > > > >> # End of the makefile >> > > > > > >> >> > > > > > >> and the script that i am using is >> > > > > > >> >> > > > > > >> #!/bin/bash >> > > > > > >> #$ -cwd >> > > > > > >> #$ -j y >> > > > > > >> #$ -S /bin/bash >> > > > > > >> #$ -pe orte 14 >> > > > > > >> #$ -N job >> > > > > > >> #$ -q new.q >> > > > > > >> >> > > > > > >> export OMP_NUM_THREADS=8 >> > > > > > >> /usr/bin/time -f "%E" /opt/openmpi/bin/mpirun -v -np $NSLOTS >> > > > > > >> ./inverse.exe >> > > > > > >> >> > > > > > >> am I forgetting something? >> > > > > > >> >> > > > > > >> Thanks, >> > > > > > >> >> > > > > > >> Oscar Fabian Mojica Ladino >> > > > > > >> Geologist M.S. in Geophysics >> > > > > > >> ___ >> > > > > > >> users mailing list >> > > > > > >> us...@open-mpi.org >> > > > > > >> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >> > > > > > >> Link to this post: >> > > > > > >> http://www.open-mpi.org/community/lists/users/2014/08/25016.php >> > > > > > > >> > > > > > >> > > > > > >> > > > > > -- >> > > > > > - >> > > > > > Maxime Boissonneault >> > > > > > Analyste de calcul - Calcul Qu饕ec, Universit・Laval >> > > > > > Ph. D. en physique >> > > > > > >> > > > > > ___ >> > > > > > users mailing list >> > > > > > us...@open-mpi.org >> > > > > > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >> > > > > > Link to this post: >> > > > > > http://www.open-mpi.org/community/lists/users/2014/08/25020.php >> > > > > ___ >> > > > > users mailing list >> > > > > us...@open-mpi.org >> > > > > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >> > > > > Link to this post: >> > > > > http://www.open-mpi.org/community/lists/users/2014/08/25032.php >> > > > >> > > > ___ >> > > > users mailing list >> > > > us...@open-mpi.org >> > > > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >> > > > Link to this post: >> > > > http://www.open-mpi.org/community/lists/users/2014/08/25034.php >> > > ___ >> > > users mailing list >> > > us...@open-mpi.org >> > > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >> > > Link to this post: >> > > http://www.open-mpi.org/community/lists/users/2014/08/25037.php >> > >> > ___ >> > users mailing list >> > us...@open-mpi.org >> > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >> > Link to this post: >> > http://www.open-mpi.org/community/lists/users/2014/08/25038.php >> ___ >> users mailing list >> us...@open-mpi.org >> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >> Link to this post: >> http://www.open-mpi.org/community/lists/users/2014/08/25079.php > >___ >users mailing list >us...@open-mpi.org >Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >Link to this post: >http://www.open-mpi.org/community/lists/users/2014/08/25080.php Tetsuya Mishima tmish...@jcity.maeda.co.jp

Re: [OMPI users] "bind-to l3chace" with r30643 in ticket #4240 dosen't work

orte_show_help("help-orte-rmaps-base.txt", "mismatch-binding", true, Regards, Tetsuya Mishima >Okay, I fixed it. Keep getting caught by a very, very unfortunate design flaw >in hwloc that forces you to treat cache's as a special case that requires you &