[OMPI users] Tuning Openmpi with IB Interconnect

2007-10-11 Thread Neeraj Chourasia
Dear All,    Could anyone tell me the important tuning parameters in openmpi with IB interconnect? I tried setting eager_rdma, min_rdma_size, mpi_leave_pinned parameters from the mpirun command line on 38 nodes cluster (38*2 processors) but in vain. I found simple mpirun with no mca parameters

Re: [OMPI users] Tuning Openmpi with IB Interconnect

2007-10-11 Thread Torsten Hoefler
Hi Neeraj, >Could anyone tell me the important tuning parameters in openmpi with >IB interconnect? I tried setting eager_rdma, min_rdma_size, >mpi_leave_pinned parameters from the mpirun command line on 38 nodes >cluster (38*2 processors) but in vain. I found simple mpirun with

Re: [OMPI users] OpenMPI and torque/maui -> crashing on MPI_Send()

2007-10-11 Thread Jeff Squyres
On Oct 10, 2007, at 11:09 AM, Jim Kusznir wrote: I've added: btl = ^openib to /etc/openmpi-mca-params.conf on the head node, but this doesn't seem to help. Does this need to be pushed out to all the compute nodes as well? Yes. -- Jeff Squyres Cisco Systems

Re: [OMPI users] Tuning Openmpi with IB Interconnect

2007-10-11 Thread Matteo Cicuttin
Il giorno 11/ott/07, alle ore 07:16, Neeraj Chourasia ha scritto: Dear All, Could anyone tell me the important tuning parameters in openmpi with IB interconnect? I tried setting eager_rdma, min_rdma_size, mpi_leave_pinned parameters from the mpirun command line on 38 nodes cluster (3

[OMPI users] Re :Re: Tuning Openmpi with IB Interconnect

2007-10-11 Thread Neeraj Chourasia
Hi,    The code was pretty simple. I was trying to send 8MB data from one rank to other in a loop(say 1000 iterations). And then i was taking the average of time taken and was calculating the bandwidth.The above logic i tried with both mpirun-with-mca-parameters and without any parameters. And t