The attached should set the gid of the remote daemons (and their children) to 
the gid of mpirun. No cmd line option or anything is required - it will just 
always do it.

Would you mind giving it a try?

Please let me know if/how it works.

Attachment: 14setgid.diff
Description: Binary data


On Sep 8, 2011, at 7:52 AM, Blosch, Edwin L wrote:

> Yes, we build OpenMPI --without-torque. 
> 
> -----Original Message-----
> From: users-boun...@open-mpi.org [mailto:users-boun...@open-mpi.org] On 
> Behalf Of Reuti
> Sent: Thursday, September 08, 2011 4:33 AM
> To: Open MPI Users
> Subject: EXTERNAL: Re: [OMPI users] Can you set the gid of the processes 
> created by mpirun?
> 
> Am 08.09.2011 um 04:04 schrieb Ed Blosch:
> 
>> Typically it is something like 'qsub -W group_list=groupB <other options>
>> myjob.sh'. Ultimately myjob.sh runs with gid groupB on some host in the
>> cluster.  When that script reaches the mpirun command, then mpirun and the
>> processes started on the same host all run with gid groupB, but any of the
>> spawned processes that start on other hosts run with the user's default
>> group, say groupA.
>> 
>> It did occur to me that the launching technique might have some ability to
>> influence this behavior as you indicated. I don't know what launcher is
>> being used in our cases, I guess it's rsh/ssh.
> 
> I can only make a statement for SGE that it would honor the group id for the 
> "built-in method" or "rsh startup method" with SGE's patched rshd, not for 
> ssh.
> 
> But you are using Torque I assume, as there is no -W switch in SGE. How did 
> you build Open MPI then? I thought the support for Torque is available by 
> default without any special switch to configure in Open MPI.
> 
> So, if the slave tasks are started by the pbs_mom, then it should also get 
> the set group id. As I don't use Torque I can't make any definite statement 
> for it.
> 
> Are you resetting inside the job script some variables to let it run outside 
> Torque, i.e. without tight integration?
> 
> -- Reuti
> 
> 
>> -----Original Message-----
>> From: users-boun...@open-mpi.org [mailto:users-boun...@open-mpi.org] On
>> Behalf Of Reuti
>> Sent: Wednesday, September 07, 2011 12:24 PM
>> To: Open MPI Users
>> Subject: Re: [OMPI users] Can you set the gid of the processes created by
>> mpirun?
>> 
>> Hi,
>> 
>> you mean you change the group id of the user before you submit the job? In
>> GridEngine you can specify whether the actual group id should be used for
>> the job, or the default login id.
>> 
>> Having a tight integration, also the slave processes will run with the same
>> group id.
>> 
>> -- Reuti
>> 
>> 
>>> Ed
>>> 
>>> From: Ralph Castain [mailto:r...@open-mpi.org] 
>>> Sent: Wednesday, September 07, 2011 8:53 AM
>>> To: Open MPI Users
>>> Subject: Re: [OMPI users] Can you set the gid of the processes created by
>> mpirun?
>>> 
>>> On Sep 7, 2011, at 7:38 AM, Blosch, Edwin L wrote:
>>> 
>>> 
>>> The mpirun command is invoked when the user's group is 'set group' to
>> group 650.  When the rank 0 process creates files, they have group ownership
>> 650.  But the user's login group is group 1040. The child processes that get
>> started on other nodes run with group 1040, and the files they create have
>> group ownership 1040.
>>> 
>>> Is there a way to tell mpirun to start the child processes with the same
>> uid and gid as the rank 0 process?
>>> 
>>> I'm afraid not - never came up before. Could be done, but probably not
>> right away. What version are you using?
>>> 
>>> 
>>> 
>>> Thanks
>>> _______________________________________________
>>> users mailing list
>>> us...@open-mpi.org
>>> http://www.open-mpi.org/mailman/listinfo.cgi/users
>>> 
>>> _______________________________________________
>>> users mailing list
>>> us...@open-mpi.org
>>> http://www.open-mpi.org/mailman/listinfo.cgi/users
>> 
>> 
>> _______________________________________________
>> users mailing list
>> us...@open-mpi.org
>> http://www.open-mpi.org/mailman/listinfo.cgi/users
>> 
>> _______________________________________________
>> users mailing list
>> us...@open-mpi.org
>> http://www.open-mpi.org/mailman/listinfo.cgi/users
> 
> 
> _______________________________________________
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
> _______________________________________________
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users

Reply via email to