Re: [OMPI users] SM btl slows down bandwidth?

2008-08-13 Thread Daniël Mantione
On Tue, 12 Aug 2008, Gus Correa wrote: > Hello Daniel and list > > Could it be a problem with memory bandwidth / contention in multi-core? Yes, I believe we are somehow limited by memory performance. Here are some numbers from a dual Opteron 2352 system, which has much more memory bandwidth:

Re: [OMPI users] Setting up Open MPI to run on multiple servers

2008-08-13 Thread jody
Hi Rayne SSH is used to start processes on the other machines - that's why you must configure ssh to work without passwords. As to your 64/32 bit problem: a program compiled for 32 bits usually works on a 64 bit machine, but not vice versa. There are methods to start MPI such that different execu

Re: [OMPI users] Fail to install openmpi 1.2.5 on bladecenter with OFED 1.3

2008-08-13 Thread Lenny Verkhovsky
Hi, check in /usr/lib it's usually folder for 32bit libraries. I think OFED1.3 comes already with Open MPI so it should be installed by default. BTW, OFED1.3.1 comes with Open MPI 1.2.6 . Lenny. On 8/12/08, Mohd Radzi Nurul Azri wrote: > > Hi, > > > Thanks for the prompt reply. This might b

Re: [OMPI users] SM btl slows down bandwidth?

2008-08-13 Thread Lenny Verkhovsky
Hi, just for the try - can run np 2 ( Ping Pong test is for 2 processes only ) On 8/13/08, Daniël Mantione wrote: > > > > On Tue, 12 Aug 2008, Gus Correa wrote: > > > Hello Daniel and list > > > > Could it be a problem with memory bandwidth / contention in multi-core? > > > Yes, I believe we ar

Re: [OMPI users] Setting up Open MPI to run on multiple servers

2008-08-13 Thread Rayne
Hi, I'm starting to think that the main problem lies in the 32-bit server not being able to execute the program compiled by the 64-bit PC, and vice versa. I just noticed that the sizes of the executables created by the PC and server are different - the one created by the 64-bit PC is 3204 bytes

Re: [OMPI users] Fail to install openmpi 1.2.5 on bladecenter with OFED 1.3

2008-08-13 Thread Pavel Shamis (Pasha)
Usually OFED installs only 64 bit version of libibverbs. If you want to install 32bit and 64bit version you need pass "--build32" flag to OFED install. So after reinstalling OFED with 32bit support, you may rebuild the OMPI for 32 bit support. Regards, Pasha Mohd Radzi Nurul Azri wrote: Hi

Re: [OMPI users] Setting up Open MPI to run on multiple servers

2008-08-13 Thread jody
An application compiled for 64-bit *IS* different from a 32-bit. But if both your 64-bit server and and 32-bit PC have compatible processor types, you can compile on the PC and run the program on the server. (as i told you in my previous mail) Jody On Wed, Aug 13, 2008 at 10:15 AM, Rayne wrote:

Re: [OMPI users] SM btl slows down bandwidth?

2008-08-13 Thread Jeff Squyres
FWIW, we have made some improvements to shared memory performance in the upcoming v1.3 series. I won't ask you to test a v1.3 tarball right now because there's a gnarly bug in the shared memory support that George is working to fix -- hopefully he'll fix it soon and you can see if the perf

Re: [OMPI users] MPI_ERR_TRUNCATE with MPI_Revc without Infinipath

2008-08-13 Thread Tom Riddle
Hi, A bit more info wrt the question below. I have run other releases of OpenMPI and they seem to be fine. The reason I need to run the latest is because it supports valgrind fully. openmpi-1.2.4 openmpi-1.3ar18303 TIA, Tom --- On Tue, 8/12/08, Tom Riddle wrote: Hi, I am getting a curious

Re: [OMPI users] SM btl slows down bandwidth?

2008-08-13 Thread Ron Brightwell
> [...] > > MPICH2 manages to get about 5GB/s in shared memory performance on the > Xeon 5420 system. Does the sm btl use a memcpy with non-temporal stores like MPICH2? This can be a big win for bandwidth benchmarks that don't actually touch their receive buffers at all... -Ron

[OMPI users] bug in MPI_File_get_position_shared ?

2008-08-13 Thread Yvan Fournier
Hello, I seem to have encountered a bug in MPI-IO, in which MPI_File_get_position_shared hangs when called by multiple processes in a communicator. It can be illustrated by the following simple test case, in which a file is simply created with C IO, and opened with MPI-IO. (defining or undefining

Re: [OMPI users] Fail to install openmpi 1.2.5 on bladecenter with OFED 1.3

2008-08-13 Thread Mohd Radzi Nurul Azri
Hi, Yup some OFED build need the 32 bit flag. The earlier issue I had is OFED 1.3 can't install properly with --build32 option. If it worked, then openmpi 1.2.5 32 bit woulr be installed as well. It's a chicken and egg thing. However now what I've done is to re-install OFED 1.3.1 plus the 32 bit

Re: [OMPI users] Setting up Open MPI to run on multiple servers

2008-08-13 Thread Rayne
Hi, I tried to see if I can get my 64-bit PC to execute 64.out, and my 32-bit server to execute 32.out, by using mpirun --bynode -np 1 64.out : -np 1 32.out My hostfile contains: localhost IP address of server However, I got the following error message: "Failed to find the following executab

Re: [OMPI users] Setting up Open MPI to run on multiple servers

2008-08-13 Thread Rayne
I just tried to explicitly specify where 32.out is on the server when using mpirun, and it worked. So the problem I had earlier did lie in the server not being able to find 32.out. So what should I do so that I don't have to explicitly specify the location of the program everytime I run mpirun?