I have a server with 12 cores.when I run mpi program with 10 processors.only three processors works.Here are a picture about the problem
why?Is the problem with process schedule?? ------------------ ???????? ------------------ ??????: "Bruno Coutinho";<couti...@dcc.ufmg.br>; ????????: 2013??12??6??(??????) ????11:14 ??????: "Open MPI Users"<us...@open-mpi.org>; ????: Re: [OMPI users]?????? can you help me please ?thanks Probably it was the changing from eager to rendezvous protocols as Jeff said. If you don't know what are these, read this: https://computing.llnl.gov/tutorials/mpi_performance/#Protocols http://blogs.cisco.com/performance/what-is-an-mpi-eager-limit/ http://blogs.cisco.com/performance/eager-limits-part-2/ You can tune eager limit chaning mca parameters btl_tcp_eager_limit (for tcp), btl_self_eager_limit (comunication fron one process to itself), btl_sm_eager_limit (shared memory) and btl_udapl_eager_limit or btl_openib_eager_limit (if you use infiniband). 2013/12/6 Jeff Squyres (jsquyres) <jsquy...@cisco.com> I sent you some further questions yesterday: http://www.open-mpi.org/community/lists/users/2013/12/23158.php On Dec 6, 2013, at 1:35 AM, ???? <781578...@qq.com> wrote: > Here is my code: > int*a=(int*)malloc(sizeof(int)*number); > MPI_Send(a,number, MPI_INT, 1, 1,MPI_COMM_WORLD); > > int*b=(int*)malloc(sizeof(int)*number); > MPI_Recv(b, number, MPI_INT, 0, MPI_ANY_TAG, MPI_COMM_WORLD, &status); > > number here is the size of my array(eg,a or b). > I have try it on my local compute and my rocks cluster.On rocks cluster, one > processor on one frontend node use "MPI_Send" send a message ,other > processors on compute nodes use "MPI_Recv" receive message . > when number is least than 10000,other processors can receive message fast; > but when number is more than 15000,other processors can receive message > slowly > why?? becesue openmpi API ?? or other problems? > > it spends me a few days , I want your help,thanks for all readers. good luck > for you > > > > > ------------------ ???????? ------------------ > ??????: "Ralph Castain";<r...@open-mpi.org>; > ????????: 2013??12??5??(??????) ????6:52 > ??????: "Open MPI Users"<us...@open-mpi.org>; > ????: Re: [OMPI users] can you help me please ?thanks > > You are running 15000 ranks on two nodes?? My best guess is that you are > swapping like crazy as your memory footprint problem exceeds available > physical memory. > > > > On Thu, Dec 5, 2013 at 1:04 AM, ???? <781578...@qq.com> wrote: > My ROCKS cluster includes one frontend and two compute nodes.In my program,I > have use the openmpi API such as MPI_Send and MPI_Recv . but when I run > the progam with 3 processors . one processor send a message ,other receive > message .here are some code. > int*a=(int*)malloc(sizeof(int)*number); > MPI_Send(a,number, MPI_INT, 1, 1,MPI_COMM_WORLD); > > int*b=(int*)malloc(sizeof(int)*number); > MPI_Recv(b, number, MPI_INT, 0, MPI_ANY_TAG, MPI_COMM_WORLD, &status); > > when number is least than 10000,it runs fast. > but number is more than 15000,it runs slowly > > why?? becesue openmpi API ?? or other problems? > ------------------ ???????? ------------------ > ??????: "Ralph Castain";<r...@open-mpi.org>; > ????????: 2013??12??3??(??????) ????1:39 > ??????: "Open MPI Users"<us...@open-mpi.org>; > ????: Re: [OMPI users] can you help me please ?thanks > > > > > > On Mon, Dec 2, 2013 at 9:23 PM, ???? <781578...@qq.com> wrote: > A simple program at my 4-node ROCKS cluster runs fine with command: > /opt/openmpi/bin/mpirun -np 4 -machinefile machines ./sort_mpi6 > > > Another bigger programs runs fine on the head node only with command: > > cd ./sphere; /opt/openmpi/bin/mpirun -np 4 ../bin/sort_mpi6 > > But with the command: > > cd /sphere; /opt/openmpi/bin/mpirun -np 4 -machinefile ../machines > ../bin/sort_mpi6 > > It gives output that: > > ../bin/sort_mpi6: error while loading shared libraries: libgdal.so.1: cannot > open > shared object file: No such file or directory > ../bin/sort_mpi6: error while loading shared libraries: libgdal.so.1: cannot > open > shared object file: No such file or directory > ../bin/sort_mpi6: error while loading shared libraries: libgdal.so.1: cannot > open > shared object file: No such file or directory > > > > _______________________________________________ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users > > > _______________________________________________ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users > > _______________________________________________ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users -- Jeff Squyres jsquy...@cisco.com For corporate legal information go to: http://www.cisco.com/web/about/doing_business/legal/cri/ _______________________________________________ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users