Re: [OMPI users] Ideal MTU in Infiniband

2008-01-10 Thread Parag Kalra
Hello all, Any ideas? -- Parag Kalra On Jan 10, 2008 4:15 AM, Parag Kalra wrote: > Hello all, > > I am using Open MPI with Infiniband configured. > > What should be the ideal MTU size for infiniband? > > -- > PARAG . A . KALRA > > > >

Re: [OMPI users] Open MPI v1.2.5 released

2008-01-10 Thread Jeff Squyres
On Jan 9, 2008, at 3:50 PM, Warner Yuen wrote: Thanks to Brian Barrett, I was able to get through some ugly Intel compiler bugs during the configure script. I now have OMPI v1.2.5 running nicely under Mac OSX v10.5 Leopard! Excellent! However, I have a question about hostfiles. I would lik

Re: [OMPI users] Ideal MTU in Infiniband

2008-01-10 Thread Gleb Natapov
On Thu, Jan 10, 2008 at 06:23:50PM +0530, Parag Kalra wrote: > Hello all, > > Any ideas? Yes. The idea is that Open MPI knows what best. Run it with a default value. Usually bigger MTU is better, but some HW has bugs. Open MPI knows this and choses the best value for your HW. > > -- > Parag Kalr

Re: [OMPI users] Ideal MTU in Infiniband

2008-01-10 Thread Parag Kalra
But still can someone please tell the numerical value that is idealy set or should be set. On Jan 10, 2008 8:29 PM, Gleb Natapov wrote: > On Thu, Jan 10, 2008 at 06:23:50PM +0530, Parag Kalra wrote: > > Hello all, > > > > Any ideas? > Yes. The idea is that Open MPI knows what best. Run it with a

[OMPI users] openib problems

2008-01-10 Thread Brock Palen
We just updated rhel4 a few days back and now we get the following errors when trying to run on infiniband nodes with openmpi-1.2.3 and openmpi-1.2.0 [0,1,1]: OpenIB on host nyx397 was unable to find any HCAs. Another transport will be used instead, although this may result in lower performan

Re: [OMPI users] openib problems

2008-01-10 Thread Jeff Squyres
This can mean that you have a user-level libibverbs and kernel mismatch. Do any of the OFED sample programs work properly, or perhaps the ibv_devinfo program? (ibv_devinfo should query the HCAs on your host and list the status of all the ports) On Jan 10, 2008, at 2:33 PM, Brock Palen wr

Re: [OMPI users] Open MPI v1.2.5 released

2008-01-10 Thread 8mj6tc902
Hi Warner. The simplest way would certainly be to launch your job with with the mpirun --nolocal option. If you're sure you want a hostfile-based way to set this, simply removing the headnode from the hostfile would also work. -- --Kris 叶ってしまう夢は本当の夢と言えん。 [A dream that comes true can't really be

Re: [OMPI users] Ideal MTU in Infiniband

2008-01-10 Thread Jeff Squyres
In an Open MPI installation, have a look in $prefix/share/openmpi/mca- btl-openib-hca-params.ini, find your HCA hardware, and you'll see what value Open MPI sets the MTU to. Hope that helps. On Jan 10, 2008, at 1:56 PM, Parag Kalra wrote: But still can someone please tell the numerical valu