Re: [OMPI users] flash2.5 with openmpi

2008-01-25 Thread Brock Palen
I dont think so, we are using the hdf5 serial io module, our hosts have just 1 gb ethernet and our OSS has gigbit also. But again our lustre setup is brand-new with only a few users so its effectively Idle. We also see the same behavior on NFS v3 backed by OnStor bobcats. Brock Palen Center

Re: [OMPI users] flash2.5 with openmpi

2008-01-25 Thread Jeff Pummill
Brock, The only thing that came to mind was that possibly on the second dump, the I/O was substantial enough to cause an overload of the OSS's (I/O servers) resulting in a process or task hang? Can you tell if your Lustre environment is getting overwhelmed when the Open MPI / FLASH combinatio

Re: [OMPI users] flash2.5 with openmpi

2008-01-25 Thread Brock Palen
I started a new run with some changes, Shortening the run wont work well, it takes 3 days just to get through the AMR. Brock Palen Center for Advanced Computing bro...@umich.edu (734)936-1985 On Jan 25, 2008, at 3:01 PM, Daniel Pfenniger wrote: Hi, Brock Palen wrote: Is anyone using fla

Re: [OMPI users] flash2.5 with openmpi

2008-01-25 Thread Daniel Pfenniger
Hi, Brock Palen wrote: Is anyone using flash with openMPI? we are here, but when ever it tries to write its second checkpoint file it segfaults once it gets to 2.2GB always in the same location. Debugging is a pain as it takes 3 days to get to that point. Just wondering if anyone else h

Re: [OMPI users] flash2.5 with openmpi

2008-01-25 Thread Brock Palen
Yes that is true. The underlying filesystems are ether NFSv3 provided by a OnStor bobcat, or a simple Lustre cluster. All systems are 64bit x86_64. We create files larger than 2GB al the time. Brock Palen Center for Advanced Computing bro...@umich.edu (734)936-1985 On Jan 25, 2008, at

Re: [OMPI users] flash2.5 with openmpi

2008-01-25 Thread Jeff Pummill
I'm guessing he means the ASC FLASH code which simulates star explosions... Brock? Jeff F. Pummill University of Arkansas // Doug Reeder wrote: Brock, Do you mean flash memory, like a USB memory stick. What kid of file system is on the memory. Is there some filesystem limit you are bump

Re: [OMPI users] flash2.5 with openmpi

2008-01-25 Thread Doug Reeder
Brock, Do you mean flash memory, like a USB memory stick. What kid of file system is on the memory. Is there some filesystem limit you are bumping into. Doug Reeder On Jan 25, 2008, at 8:38 AM, Brock Palen wrote: Is anyone using flash with openMPI? we are here, but when ever it tries to