Re: [OMPI users] Re :Re: Tuning Openmpi with IB Interconnect

2007-10-12 Thread Torsten Hoefler
Hello, >The code was pretty simple. I was trying to send 8MB data from one >rank to other in a loop(say 1000 iterations). And then i was taking the >average of time taken and was calculating the bandwidth. > >The above logic i tried with both mpirun-with-mca-parameters and with

[OMPI users] Re :Re: Re :Re: Tuning Openmpi with IB Interconnect

2007-10-12 Thread Neeraj Chourasia
Yes, the buffer was being re-used. No we didnt try to benchmark it with netpipe and other stuffs. But the program was pretty simple. Do you think, I need to test it with bigger chunks (>8MB) for communication.?We also tried manipulating eager_limit and min_rdma_sze, but no success.NeerajOn Fri,

Re: [OMPI users] Re :Re: Re :Re: Tuning Openmpi with IB Interconnect

2007-10-12 Thread Jeff Squyres
On Oct 12, 2007, at 8:38 AM, Neeraj Chourasia wrote: Yes, the buffer was being re-used. No we didnt try to benchmark it with netpipe and other stuffs. But the program was pretty simple. Do you think, I need to test it with bigger chunks (>8MB) for communication.? We also tried manipulating

Re: [OMPI users] Re :Re: Re :Re: Tuning Openmpi with IB Interconnect

2007-10-12 Thread Jeff Squyres
The mailing list snipped off the end of my mail -- here's the rest of what I said: The meanings of the 3 phases are explained in this pager: http:// www.open-mpi.org/papers/euro-pvmmpi-2006-hpc-protocols. If you use the mpi_leave_pinned parameter and Open MPI is able to leave your entire buffe

[OMPI users] FW: [mpi-21] SC'07 MPI Forum organization meeting

2007-10-12 Thread Richard Graham
-- Forwarded Message From: Richard Graham Reply-To: "mpi...@mpi-forum.org" List-Post: users@lists.open-mpi.org Date: Fri, 12 Oct 2007 12:48:04 -0400 To: "mpi...@mpi-forum.org" Conversation: SC'07 MPI Forum organization meeting Subject: [mpi-21] SC'07 MPI Forum organization meeting As previ

Re: [OMPI users] Open MPI 1.2.4 verbosity w.r.t. osc pt2pt

2007-10-12 Thread Brian Granger
> That's the same for R. We don;t touch the innert guts of module loading for > this . What Hao realized after looking at the corresponding FAQ item was that > right before calling MPI_Init, one can load libmpi explicitly, and -- and > that;s the important bit -- set the proper RTLD_GLOBAL argument

Re: [OMPI users] Open MPI 1.2.4 verbosity w.r.t. osc pt2pt

2007-10-12 Thread Brian Granger
> My guess is that Rmpi is dynamically loading libmpi.so, but not > specifying the RTLD_GLOBAL flag. This means that libmpi.so is not > available to the components the way it should be, and all goes > downhill from there. It only mostly works because we do something > silly with how we link most

Re: [OMPI users] Open MPI 1.2.4 verbosity w.r.t. osc pt2pt

2007-10-12 Thread Dirk Eddelbuettel
Brian, On 12 October 2007 at 13:55, Brian Granger wrote: | > My guess is that Rmpi is dynamically loading libmpi.so, but not | > specifying the RTLD_GLOBAL flag. This means that libmpi.so is not | > available to the components the way it should be, and all goes | > downhill from there. It only

Re: [OMPI users] Re :Re: Re :Re: Tuning Openmpi with IB Interconnect

2007-10-12 Thread Torsten Hoefler
Hi, >Yes, the buffer was being re-used. No we didnt try to benchmark it with >netpipe and other stuffs. But the program was pretty simple. Do you think, >I need to test it with bigger chunks (>8MB) for communication.? >We also tried manipulating eager_limit and min_rdma_sze, but no