Re: [OMPI users] Rank specific argument to mpirun

2016-07-29 Thread Saliya Ekanayake
I tested and the number of ranks in world comm is correct. I couldn't find the bug that causes the program to produce erroneous answers when this scheme is used, though. On Fri, Jul 29, 2016 at 3:38 PM, Saliya Ekanayake wrote: > Thank you, that's good to know. > > Yes, testing this now. I'll let

Re: [OMPI users] mpirun won't find programs from the PATH environment variable that are in directories that are relative paths

2016-07-29 Thread Phil Regier
If I'm reading you right, you're presently unable to do the equivalent (albeit probably with PATH set on a different line somewhere above) of PATH=arch/x86_64-rhel7-gcc48-opt/bin mpirun -n 1 psana I'm mildly curious whether it would help to add a leading "./" to get the equivalent of PATH=./arch

Re: [OMPI users] EXTERNAL: Re: Question on run-time error "ORTE was unable to reliably start"

2016-07-29 Thread Ralph Castain
Really scratching my head over this one. The app won’t start running until after all the daemons have been launched, so this doesn’t seem possible at first glance. I’m wondering if something else is going on that might lead to a similar error? Does the application call comm_spawn, for example? O

Re: [OMPI users] mpirun won't find programs from the PATH environment variable that are in directories that are relative paths

2016-07-29 Thread Ralph Castain
I’ll take a look - that doesn’t sound like intended behavior > On Jul 29, 2016, at 5:25 PM, Schneider, David A. > wrote: > > Right now I'm just doing mpirun local. We use lsf bsub to launch on the > cluster. > > best, > > David Schneider > SLAC/LCLS >

Re: [OMPI users] mpirun won't find programs from the PATH environment variable that are in directories that are relative paths

2016-07-29 Thread Schneider, David A.
Right now I'm just doing mpirun local. We use lsf bsub to launch on the cluster. best, David Schneider SLAC/LCLS From: users [users-boun...@lists.open-mpi.org] on behalf of Ralph Castain [r...@open-mpi.org] Sent: Friday, July 29, 2016 5:19 PM To: Open MPI

Re: [OMPI users] mpirun won't find programs from the PATH environment variable that are in directories that are relative paths

2016-07-29 Thread Schneider, David A.
Hi, Thanks for the reply! It does look like mpirun runs from the same directory as where I launch it, and that the environment has the same value for PATH that I had before (with the relative directory in front), but of course, there are lots of other MPI based environment variables defined - ma

Re: [OMPI users] mpirun won't find programs from the PATH environment variable that are in directories that are relative paths

2016-07-29 Thread Ralph Castain
Typical practice would be to put a ./myprogram in there to avoid any possible confusion with a “myprogram” sitting in your $PATH. We should search the PATH to find your executable, but the issue might be that it isn’t your PATH on a remote node. So the question is: are you launching strictly lo

Re: [OMPI users] mpirun won't find programs from the PATH environment variable that are in directories that are relative paths

2016-07-29 Thread Phil Regier
I might be three steps behind you here, but does "mpirun pwd" show that all your launched processes are running in the same directory as the mpirun command? I assume that "mpirun env" would show that your PATH variable is being passed along correctly, since you don't have any problems with absol

[OMPI users] mpirun won't find programs from the PATH environment variable that are in directories that are relative paths

2016-07-29 Thread Schneider, David A.
I am finding, on linux, rhel7, with openmpi 1.8.8 and 1.10.3, that mpirun won't find apps that are specified on a relative path, i.e, if I have PATH=dir/bin and I am in a directory which has dir/bin as a subdirectory, and an executable bir/bin/myprogram, I can't do mpirun myprogram I get the

Re: [OMPI users] OPENSHMEM ERROR

2016-07-29 Thread Jeff Squyres (jsquyres)
> On Jul 29, 2016, at 8:49 AM, Jeff Squyres (jsquyres) > wrote: > > What happens when you run the ring_c test program, do you get the same error > as you do with hello_oshmem_c? I'm guessing ring_c will work, but oshmem_hello will still segv; I was just able to reproduce the problem. I file

Re: [OMPI users] Rank specific argument to mpirun

2016-07-29 Thread Saliya Ekanayake
Thank you, that's good to know. Yes, testing this now. I'll let you know On Fri, Jul 29, 2016 at 3:33 PM, Ralph Castain wrote: > FWIW: I just tested it on master, and all the procs are in the same > comm_world. However, that was with a C application, not Java. > > Saliya: can you please check t

Re: [OMPI users] Rank specific argument to mpirun

2016-07-29 Thread Ralph Castain
FWIW: I just tested it on master, and all the procs are in the same comm_world. However, that was with a C application, not Java. Saliya: can you please check to see if Java is behaving differently? A simple app that gets and prints out its rank is all that is required. > On Jul 29, 2016, at 1

Re: [OMPI users] Rank specific argument to mpirun

2016-07-29 Thread Saliya Ekanayake
Thanks, Udayanga. I'll check this. Ralph, I'll try to print some debug info from the code and check why this logic fails and will let you know. On Fri, Jul 29, 2016 at 3:18 PM, Ralph Castain wrote: > Actually, what Saliya describes sounds like a bug - those procs must all > be assigned to the s

Re: [OMPI users] Rank specific argument to mpirun

2016-07-29 Thread Ralph Castain
Actually, what Saliya describes sounds like a bug - those procs must all be assigned to the same comm_world. Saliya: are you sure they are not? What ranks are you seeing? > On Jul 29, 2016, at 12:12 PM, Udayanga Wickramasinghe > wrote: > > Hi, > I think orte/ompi-mca foward number of environ

Re: [OMPI users] Rank specific argument to mpirun

2016-07-29 Thread Udayanga Wickramasinghe
Hi, I think orte/ompi-mca foward number of environment variables (ie:- $OMPI_*) to its ranks. So I believe you may use $OMPI_COMM_WORLD_LOCAL_RANK to specifically filter out parameters within the script. Regards Udayanga Wickramasinghe Research Assistant School of Informatics and Computing | CREST

[OMPI users] Rank specific argument to mpirun

2016-07-29 Thread Saliya Ekanayake
Hi, I am invoking my Java MPI program as, mpirun opts script.sh Now, I want to pass some rank specific argument to this script. For example, I need to enable GC logs for one of the processes only, so I need to pass an argument to the JVM if that's rank0 to do GC logs. I've asked the same questi

Re: [OMPI users] OPENSHMEM ERROR

2016-07-29 Thread Jeff Squyres (jsquyres)
What happens when you run the ring_c test program, do you get the same error as you do with hello_oshmem_c? Can you send all the information listed here: https://www.open-mpi.org/community/help/ > On Jul 29, 2016, at 6:15 AM, Debendra Das wrote: > > I have installed OpenMPI-2.0.0 in 2 s

[OMPI users] OPENSHMEM ERROR

2016-07-29 Thread Debendra Das
I have installed OpenMPI-2.0.0 in 2 systems with IP addresses 172.16.5.33 and 172.16.5.32. I have compiled the hello_c.c and hello_oshmem_c.c files which are in the examples directory. The respective object files are hello_c and hello_oshmem_c. When I am executing hello_c it is running fine, but wh