Re: [OMPI users] MPI-IO Inconsistency over Lustre using OMPI 1.3

2009-03-04 Thread Jeff Squyres
Unfortunately, we don't have a whole lot of insight into how the internals of the IO support work -- we mainly bundle the ROMIO package from MPICH2 into Open MPI. Our latest integration was the ROMIO from MPICH2 v1.0.7. Do you see the same behavior if you run your application under MPICH2

Re: [OMPI users] MPI-IO Inconsistency over Lustre using OMPI 1.3

2009-03-03 Thread Nathan Baca
Thanks for the quick reply and suggestions. I have tried both isolating the output to a single OST and striping across multiple OSTs. Both will produce the same result. I have tried compiling with multiple versions of both pathscale and intel compilers all with the same result. The odd thing is t

Re: [OMPI users] MPI-IO Inconsistency over Lustre using OMPI 1.3

2009-03-03 Thread Brian Dobbins
Hi Nathan, I just ran your code here and it worked fine - CentOS 5 on dual Xeons w/ IB network, and the kernel is 2.6.18-53.1.14.el5_lustre.1.6.5smp. I used an OpenMPI 1.3.0 install compiled with Intel 11.0.081 and, independently, one with GCC 4.1.2. I tried a few different times with varying

[OMPI users] MPI-IO Inconsistency over Lustre using OMPI 1.3

2009-03-03 Thread Nathan Baca
Hello, I am seeing inconsistent mpi-io behavior when writing to a Lustre file system using open mpi 1.3 with romio. What follows is a simple reproducer and output. Essentially one or more of the running processes does not read or write the correct amount of data to its part of a file residing on a