Re: [OMPI users] Can't start more than one process in a node as normal user

2007-01-29 Thread Jeff Squyres
Sorry for the delay in replying to this -- if normal users can't create mmaped shared memory files, then our shared memory ("sm") device will fail. I'm afraid I don't know much about OpenSSI -- perhaps they have some specific restrictions about mmaped files...? On Jan 21, 2007, at 9:17 PM

Re: [OMPI users] Can't start more than one process in a node as normal user

2007-01-21 Thread eddie168
Hi Ralph and Jeff, Thanks a lot for the advice. Our cluster setup is pretty "limited", it is an OpenSSI cluster with several P3 and P4 machines connected through Ethernet. So I guess we won't be able to take full speed advantage of the current OMPI implementation. So far I narrowed down the prob

Re: [OMPI users] Can't start more than one process in a node as normal user

2007-01-18 Thread Ralph Castain
What that parameter does is turn ³off² all of the transports except tcp ­ so the problem you¹re seeing goes away because we no longer try to create the shared memory file. This will somewhat hurt your performance, but it will work. Alternatively, you could use ³--mca btl ^sm², which would allow yo

Re: [OMPI users] Can't start more than one process in a node as normal user

2007-01-18 Thread Jeff Squyres
Two things: 1. You will definitely need to also specify the "self" BTL. Otherwise, if you have an MPI process that tries to send to itself, there will be no [internal OMPI] path for that message to follow, and an MPI exception will occur. mpirun --mca btl tcp,self -np 2 tut01 2.

Re: [OMPI users] Can't start more than one process in a node as normal user

2007-01-18 Thread eddie168
Just to answer my own question, after I explicitly specify the "--mca btl tcp" parameter, the program works. So I will need to issue command like this: $ mpirun --mca btl tcp -np 2 tut01 oceanus:Hello world from 0 oceanus:Hello world from 1 Regards, Eddie. On 1/18/07, eddie168 wrote: Hi Ra

Re: [OMPI users] Can't start more than one process in a node as normal user

2007-01-17 Thread eddie168
Hi Ralph and Brian, Thanks for the advice, I have checked the permission to /tmp drwxrwxrwt 19 root root 4096 Jan 18 11:38 tmp which I think there shouldn't be any problem to create files there, so option (a) still not work for me. I tried option (b) which set --tmpdir on command line and

Re: [OMPI users] Can't start more than one process in a node as normal user

2007-01-17 Thread Brian W. Barrett
errno 13 on Linux is EACCESS. According to the man page, ftruncate() only retrns errno 13 if the file is owned by another user. I can't see exactly how this could occur, but you might want to look at /tmp/ and make sure everything in openmpi-sessions-eddie* is owned by user eddie. Bri

Re: [OMPI users] Can't start more than one process in a node as normal user

2007-01-17 Thread Ralph H Castain
Hi Eddie Open MPI needs to create a temporary file system ­ what we call our ³session directory² - where it stores things like the shared memory file. From this output, it appears that your /tmp directory is ³locked² to root access only. You have three options for resolving this problem: (a) you

[OMPI users] Can't start more than one process in a node as normal user

2007-01-17 Thread eddie168
Dear all, I have recently installed OpenMPI 1.1.2 on a OpenSSI cluster running Fedora core 3. I tested a simple hello world mpi program (attached) and it runs ok as root. However, if I run the same program under normal user, it gives the following error: [eddie@oceanus:~/home2/mpi_tut]$ mpirun -