On Wed, Jul 23, 2008 at 09:47:56AM -0400, Robert Kubrick wrote:
> HDF5 supports parallel I/O through MPI-I/O. I've never used it, but I
> think the API is easier than direct MPI-I/O, maybe even easier than raw
> read/writes given its support for hierarchal objects and metadata.
In addition to t
On Wed, Jul 23, 2008 at 01:28:53PM +0100, Neil Storer wrote:
> Unless you have a parallel filesystem, such as GPFS, which is
> well-defined and does support file-locking, I would suggest writing to
> different files, or doing I/O via a single MPI task, or via MPI-IO.
I concur that NFS for a parall
On Wed, Jul 23, 2008 at 02:24:03PM +0200, Gabriele Fatigati wrote:
> >You could always effect your own parallel IO (e.g., use MPI sends and
> receives to coordinate parallel reads and writes), but >why? It's already
> done in the MPI-IO implementation.
>
> Just a moment: you're saying that i can
HDF5 supports parallel I/O through MPI-I/O. I've never used it, but I
think the API is easier than direct MPI-I/O, maybe even easier than
raw read/writes given its support for hierarchal objects and metadata.
HDF5 supports multiple storage models and it supports MPI-IO.
HDF5 has an open inter
Jeff,
In general NFS servers run a file-locking daemon that should enable
clients to lock files.
However, in Unix, there are two flavours of file locking, flock() from
BSD and lockf() from System V. It varies from system to system which of
these mechanisms work with NFS. In Solaris lockf() works
On Jul 23, 2008, at 8:24 AM, Gabriele Fatigati wrote:
>You could always effect your own parallel IO (e.g., use MPI sends
and receives to coordinate parallel reads and writes), but >why?
It's already done in the MPI-IO implementation.
Just a moment: you're saying that i can do fwrite withou
>You could always effect your own parallel IO (e.g., use MPI sends and
receives to coordinate parallel reads and writes), but >why? It's already
done in the MPI-IO implementation.
Just a moment: you're saying that i can do fwrite without any lock? OpenMPI
does this?
And, what is ROMIO? Where can
On Jul 23, 2008, at 6:35 AM, Gabriele Fatigati wrote:
>There is a whole chapter in the MPI standard about file I/O
operations. I'm quite confident you will find whatever you're
looking for there :)
Hi George, i know this chapter :) But i'm using MPI-1, not MPI-2. I
would like to know meth
>There is a whole chapter in the MPI standard about file I/O operations. I'm
quite confident you will find whatever you're looking for there :)
Hi George, i know this chapter :) But i'm using MPI-1, not MPI-2. I would
like to know methods for I/O with MPI-1.
2008/7/23 George Bosilca :
> There is
There is a whole chapter in the MPI standard about file I/O
operations. I'm quite confident you will find whatever you're looking
for there :)
Open MPI use ROMIO for file operations, and normally this is compiled
in by default. You should not have any troubles using MPI I/O with
Open MPI.
Hi,
i have a question about parallel i/o. In my application, actually i have
implemented a file lock with C system calls, like flock. But, is this the
right way to do concurrent write?
In this cluster, every node has our operating system, so, the file lock
functions only on the processors of that
11 matches
Mail list logo
