Re: [OMPI users] MPI_Bcast from OpenMPI

But, exactly the same program gets different result in another cluster. I mean the result doent have any spike at all. Second cluster is almost the same features with the previous one except little small memory capacity and little low frequency. First cluster: 3.0 GHz Intel Xeon, 4GB memory, centO

Re: [OMPI users] few Problems

Hi all, I tried as described in the documentation (I have did this before) so the problem now is: I'm using NFS, my home dir is the same in all nodes the problem is when generating the key it is been generated for a specific machine end of the key is the user@host, the system is consulting

Re: [OMPI users] [Fwd: mpi alltoall memory requirement]

I think Ashley still has the right general idea. You need to see how much memory the OS is taking off the top. Then see how much memory the application images consume (before using any memory). Open MPI itself then takes up a bunch of memory for its own internal buffering. Remember, too,

[OMPI users] Open-MPI Presentation

Hi, I'm a grad student, working on a MPI communication optimization, and I've been working with Open-MPI for quite a while now. I'm also a TA in a course about open-source development, and I would like to present Open-MPI as a case study. In particular, I thought about something along the lines of

Re: [OMPI users] Launching MPI app manually when rsh/ssh can't beused...

On Apr 23, 2009, at 3:51 AM, Katz, Jacob wrote: Is there a way to start up an MPI app by some manual procedure, when rsh/ssh cannot be used to log into a machine where part of the app should run? E.g. a set of commands that can be manually executed on the machines to start the run-time/daem

Re: [OMPI users] pls_rsh_agent deprecated?

Excellent point -- the FAQ was outdated. Along with some other FAQ updates this morning, I updated these two entries: http://www.open-mpi.org/faq/?category=running#pls-rsh-agent http://www.open-mpi.org/faq/?category=rsh#rsh-not-ssh Sorry for the confusion! On Apr 23, 2009, at 8:56 A

Re: [OMPI users] Problem with running openMPI program

Excellent answer. One addendum -- we had a really nice FAQ entry about this kind of stuff on the LAM/MPI web site, which I was horrified to see that we had not copied to the Open MPI site. So I copied it over this morning. :-) Have a look at these 3 FAQ (brand new) entries: http://w

Re: [OMPI users] [Fwd: mpi alltoall memory requirement]

yes of course i m sure about wellness of providers and i m using ofed-1.4.1-rc3 i m running 24 proc per node on 8 node cluster. so as i showed in calculation that i require 36G mem. i just need to know if my calculation has not some obvious flaw and/or if i m missing anything about sett

Re: [OMPI users] [Fwd: mpi alltoall memory requirement]

What is the NIC you use? What OFED build? Are you sure about wellness of provider lib/drivers..? It is strange that you get out of mem in all to all tests... should not happen on 32G system,..!!! -polk. On 4/23/09, viral@gmail.com wrote: > > or any link which helps to understand system reui

Re: [OMPI users] MPI_Bcast from OpenMPI

Okay.  So, going back to Jeff's second surprise, we have 256 Mbyte/2.5 sec = 100 Mbyte/sec = 1 Gbit/sec (sloppy math).  So, without getting into details of what we're measuring/reporting here, there doesn't on the face of it appear to be anything wrong with the baseline performance.  Jeff was r

Re: [OMPI users] Open-MPI and gprof

@Daniel: thanks - i could compile vprof now! Jody On Thu, Apr 23, 2009 at 12:35 PM, Daniel Spångberg wrote: > Regarding miscompilation of vprof and bfd_get_section_size_before_reloc. > Simply change the call from bfd_get_section_size_before_reloc to > bdf_get_section_size in exec.cc and recompi

Re: [OMPI users] Open-MPI and gprof

jody wrote: If i get vprof or one of the other tools running, i'll write something up - perhaps the profiling subject would be worthy for a FAQ entry... Yes, perhaps. Note that there really are lots of options out there. Spend a few minutes googling. There are tools, surveys of tools, et

Re: [OMPI users] Problem with running openMPI program

Hi Ankush Jeff already sent clarifications about image processing, and the portable API nature of OpenMPI (and other MPI implementations). As for "mpicc: command not found" this is again a problem with your PATH. Remember the "locate" command? :) Find where mpicc is installed, and put that dire

Re: [OMPI users] Bogus memcpy or bogus valgrind record

Hello all, I have had no answers regarding the trouble (OpenMPI bug ?) I evidenced when combining OpenMPI and valgrind. I tried it with a newer version of OpenMPI, and the problems persist, with new, even more worrying, error messages being displayed : ==32142== Warning: client syscall munmap t

Re: [OMPI users] pls_rsh_agent deprecated?

It will still work, but it has been deprecated. Are you talking about the 1.3.x series, or in our development trunk? In the 1.3.x series, the parameter is now plm_rsh_agent. In the trunk, you can also specify it as orte_rsh_agent. On Thu, Apr 23, 2009 at 6:14 AM, Katz, Jacob wrote: > Hi, > >

Re: [OMPI users] [Fwd: mpi alltoall memory requirement]

or any link which helps to understand system reuirement for certain test scenario .. On Apr 23, 2009 12:42pm, viral@gmail.com wrote: Hi Thanks for your response. However, I am running mpiexec -ppn 24 -n 192 /opt/IMB-MPI1 alltaoll -msglen /root/temp And file /root/temp contains entry

Re: [OMPI users] Problem with running openMPI program

MPI is an API specification, meaning that correctly-written MPI applications are source-code compatible across all MPI implementations. Hence, these tutorial examples will compile and run with Open MPI just as well as they will with LAM/MPI (I actually helped write those tutorial examples

Re: [OMPI users] MPI_Bcast from OpenMPI

Sorry, I had a mistake in calculation. Not 131072 (double) but 131072 KB. It means around 128 MB. From: Jeff Squyres To: Open MPI Users Sent: Thursday, April 23, 2009 8:23:52 PM Subject: Re: [OMPI users] MPI_Bcast from OpenMPI Very strange; 6 seconds for a 1

[OMPI users] pls_rsh_agent deprecated?

Hi, I tried using pls_rsh_agent parameter as instructed in http://www.open-mpi.org/faq/?category=rsh, but got a message that it's deprecated. Is this so? Has it been superseded by some other parameters? Thanks. Jacob M. Katz | jacob.k...@intel.com

Re: [OMPI users] Problem with running openMPI program

i have gone through that course, but i still am not at a stage where i can develop a MPI program, so was looking for some IP programs on the net. Will try the imageproc.cprogram which i found http://lam-mpi.lzu.edu.cn/tutorials/nd/part1/

Re: [OMPI users] MPI_Bcast from OpenMPI

Hi, Hardware setups: + We have 4 NICs for each node in our cluster. That is why I called 4 links. + All nodes are connected by 4 switches (1Gb switch). + 4GB memory for each node. How can I check that NUMA or UMA memory access? Thank you! From: Jeff Squyres To

Re: [OMPI users] Problem with running openMPI program

Yes, they will run. Note that these are toy image processing examples; they are no substitute for a real image processing application. You might want to look at a full MPI tutorial to get an understanding of MPI itself: http://ci-tutor.ncsa.uiuc.edu/login.php Register (it's free), log

Re: [OMPI users] Problem with running openMPI program

On Apr 23, 2009, at 3:40 AM, Ankush Kaul wrote: I am again stuck on a problem, i connected a new node to my cluster and installed CentOS 5.2 on it. after that i use yum to install openmpi,openmpi-libs and openmpi-devel sucessfully. Be sure that you have the same version of Open MPI installe

Re: [OMPI users] MPI_Bcast from OpenMPI

Very strange; 6 seconds for a 1MB broadcast over 64 processes is *way* too long. Even 2.5 sec at 2MB seems too long -- what is your network speed? I'm not entirely sure what you mean by "4 link" on your graph. Without more information, I would first check your hardware setup to see if the

Re: [OMPI users] Problem with running openMPI program

I found some programs on this link : http://lam-mpi.lzu.edu.cn/tutorials/nd/part1/ will these program run on my openmpi cluster? actually i want to run some image processing program on my cluster, as i cannot write the entire code of the program can anyone tell where can i get ip programs. I kno

Re: [OMPI users] Could following situations caused by RDMAmcaparameters?

On Apr 22, 2009, at 11:43 PM, Tsung Han Shie wrote: Unfortunately, after I thoroughly examined entire cluster, I found a bad node with busted hard drive. That's the reason why this job hanged. Also, when this job is sent with one bad node among the machinefile, neither the openmpi nor my pr

Re: [OMPI users] Open-MPI and gprof

Regarding miscompilation of vprof and bfd_get_section_size_before_reloc. Simply change the call from bfd_get_section_size_before_reloc to bdf_get_section_size in exec.cc and recompile. Daniel Spångberg Den 2009-04-23 10:16:07 skrev jody : Hi all Thanks for all the input. I have not gotten

Re: [OMPI users] Open-MPI and gprof

Hi all Thanks for all the input. I have not gotten around to try any of the tools (Sun Studio, Tau or vprof). Actually, i can't compile vprof - make fails with exec.cc: In static member function ‘static void BFDExecutable::find_address_in_section(bfd*, asection*, void*)’: exec.cc:144: error: ‘

[OMPI users] Launching MPI app manually when rsh/ssh can't be used...

Hi, Is there a way to start up an MPI app by some manual procedure, when rsh/ssh cannot be used to log into a machine where part of the app should run? E.g. a set of commands that can be manually executed on the machines to start the run-time/daemons/actual executables? Thanks. -

[OMPI users] Fw: MPI_Bcast from OpenMPI

- Forwarded Message From: shan axida To: Open MPI Users Sent: Thursday, April 23, 2009 2:32:08 PM Subject: MPI_Bcast from OpenMPI Hi, One more question: I have executed the MPI_Bcast() in 64 processes in 16 nodes Ethernet multiple links cluster. The result is shown in the file at

Re: [OMPI users] Problem with running openMPI program

@Gus, Eugene I read all you mails and even followed the same procedure, it was blas that was giving the problem. Thanks I am again stuck on a problem, i connected a new node to my cluster and installed CentOS 5.2 on it. after that i use yum to install openmpi,openmpi-libs and openmpi-devel sucess

Re: [OMPI users] Open-MPI and gprof

I have used vprof, which is free, and also works well with openmpi: http://sourceforge.net/projects/vprof/ One might need slight code modifications to get output, depending on compilers used, such as adding vmon_begin(); to start profiling and vmon_done_task(rank); to end profiling where rank

Re: [OMPI users] [Fwd: mpi alltoall memory requirement]

Hi Thanks for your response. However, I am running mpiexec -ppn 24 -n 192 /opt/IMB-MPI1 alltaoll -msglen /root/temp And file /root/temp contains entry upto 65535 size only. That means alltoall test will run upto 65K size only So, in that case I will require very less memory but then in t

Re: [OMPI users] SHARED Memory----------------

shan axida wrote: It have read that FAQ. Terrific.  If you want to offer feedback for its improvement, that feedback would be welcome. Does it mean shared memory communication is used when send messages  between the processes in same node in default? Yes. No need an

[OMPI users] MPI_Bcast from OpenMPI

Hi, One more question: I have executed the MPI_Bcast() in 64 processes in 16 nodes Ethernet multiple links cluster. The result is shown in the file attached on this E-mail. What is going on at 131072 double message size? I have executed it many times but the result is still the same. THANK YOU!

Re: [OMPI users] SHARED Memory----------------

Hi, It have read that FAQ. Does it mean shared memory communication is used when send messages between the processes in same node in default? No need any options and configuration for OpenMPI shared memory? THANK YOU! From: Eugene Loh To: Open MPI Users Sen

Re: [OMPI users] SHARED Memory----------------

shan axida wrote: What I am asking is if I use MPI_Send and MPI_Recv between processes in  a node, does it mean using shared memory or not? It (typically) does.  (Some edge cases could occur.)  Your question is addressed by the FAQ I mentioned. if not, how to use  shared me

Re: [OMPI users] SHARED Memory----------------

Hi, What I am asking is if I use MPI_Send and MPI_Recv between processes in a node, does it mean using shared memory or not? if not, how to use shared memory among processes which are runing in a node? Thank you! From: Eugene Loh To: Open MPI Users Sent: T

Re: [OMPI users] SHARED Memory----------------

Just to clarify (since "send to self" strikes me as confusing)... If you're talking about using shared memory for point-to-point MPI message passing, OMPI typically uses it automatically between two processes on the same node.  It is *not* used for a process sending to itself.  There is a well