Re: [OMPI users] low CPU utilization with OpenMPI

2014-10-23 Thread Vinson Leung
You are > going to get terrible performance - possibly slowing to a crawl having all > processes open their backing files for mmap on NSF. I think that's the > error that he's getting. > > > > > > Josh > > > > On Thu, Oct 23, 2014 at 6:06 AM, Vinso

Re: [OMPI users] low CPU utilization with OpenMPI

2014-10-23 Thread Vinson Leung
possibly slowing to a crawl having all > processes open their backing files for mmap on NSF. I think that's the > error that he's getting. > > > Josh > > On Thu, Oct 23, 2014 at 6:06 AM, Vinson Leung > wrote: > >> HI, Thanks for your reply:) >> I r

Re: [OMPI users] low CPU utilization with OpenMPI

2014-10-23 Thread Vinson Leung
age, I gather you are not running an MPI program, but > rather an OSHMEM one? Otherwise, I find the message strange as it only > would be emitted from an OSHMEM program. > > What version of OMPI are you trying to use? > > On Oct 22, 2014, at 7:12 PM, Vinson Leung wrote: > >

Re: [OMPI users] low CPU utilization with OpenMPI

2014-10-22 Thread Vinson Leung
weird, try the other /tmp/ locations: /var/tmp/ /dev/shm (ram disk careful!) Brock Palen www.umich.edu/~brockp CAEN Advanced Computing XSEDE Campus Champion bro...@umich.edu (734)936-1985 > On Oct 21, 2014, at 10:18 PM, Vinson Leung wrote: > > Because of permission reason (OpenMPI can

[OMPI users] low CPU utilization with OpenMPI

2014-10-21 Thread Vinson Leung
Because of permission reason (OpenMPI can not write temporary file to the default /tmp directory), I change the TMPDIR to my local directory (export TMPDIR=/home/user/tmp ) and then the MPI program can run. But the CPU utilization is very low under 20% (8 MPI rank running in Intel Xeon 8-core CPU).