Re: [OMPI users] Distribute app over open mpi

2009-11-07 Thread Terry Frankcombe
On Fri, 2009-11-06 at 08:10 -0800, Arnaud Westenberg wrote:
> Hi all,
> 
> Sorry for the newbie question, but I'm having a hard time finding the answer, 
> as I'm not even familiar with the terminology...
> 
> I've setup a small cluster on Ubuntu (hardy) and everything is working great, 
> including slurm etc. If I run the well known 'Pi' program I get the proper 
> results returned from all the nodes.
> 
> However, I'm looking for a way such that I wouldn't need to install the 
> application on each node, nor on the shared nfs. Currently I get the obvious 
> error that the app is not found on the nodes on which it isn't installed.
> 
> The idea is that the master node would thus distribute the required (parts of 
> the) program to the slave nodes so they can perform the assigned work.
> 
> Reason is that I want to run an FEA package on a much larger (redhat) cluster 
> we currently use for CDF calculations. I really don't want to mess up the 
> cluster as we bought it already configured and compiling new versions of the 
> FEA package on it turns out to be a missing library nightmare.

I don't understand the question.  Do you have a binary that works on
your new cluster or not?  I just don't see how recompiling the code fits
with the rest of the question.  If you have an OpenMPI-linked binary for
your FEA, simply copy it out to your nodes, then run it.  There are many
ways to do this: which is best depends on many factors.  Probably scp is
your friend if you don't have a common filesystem.




Re: [OMPI users] Help: Firewall problems

2009-11-07 Thread Lee Amy
On Fri, Nov 6, 2009 at 7:15 PM, Jeff Squyres  wrote:
> On Nov 6, 2009, at 5:49 AM, Lee Amy wrote:
>
>> Thanks. And actually I don't know if I need to disable iptables to run
>> MPI programs properly. Obviously from your words Open MPI will use
>> random ports so how do I set up in iptables then let trusted machines
>> open their random ports?
>>
>
>
> I'm afraid I'm not enough of an iptables expert to know (I don't know if
> anyone else on this list will be, either) -- you'll need to check the
> iptables docs to see.
>
> Sorry!
>
> --
> Jeff Squyres
> jsquy...@cisco.com
>
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
>

That's okay. Thank you all the same. You provide me lots of
information about that.

Thanks.

Amy


Re: [OMPI users] an environment variable with same meaning than the-x option of mpiexec

2009-11-07 Thread Jeff Squyres
FWIW, environment variables prefixed with "OMPI_" will automatically  
be distributed out to processes.  From mpirun(1):


   Exported Environment Variables
   All  environment variables that are named in the form OMPI_*  
will auto-
   matically be exported to new processes on the local and   
remote  nodes.
   The  -x  option  to  mpirun  can be used to export specific  
environment
   variables to the new processes.  While the  syntax  of  the  - 
x  option
   allows  the  definition of new variables, note that the parser  
for this
   option is currently not very sophisticated - it does  not   
even  under-
   stand  quoted  values.  Users are advised to set variables in  
the envi-

   ronment and use -x to export them; not to define them.

Depending on your environment and launcher, your entire environment  
may be copied out to all the processes, anyway (rsh does not, but  
environments like SLURM do), making the OMPI_* and -x mechanisms  
somewhat redundant.


Does this help?


On Nov 6, 2009, at 9:59 PM, Ralph Castain wrote:


Not at the moment - though I imagine we could create one. It is a tad
tricky in that we allow multiple -x options on the cmd line, but we
obviously can't do that with an envar.

The most likely solution would be to specify multiple "-x" equivalents
by separating them with a comma in the envar. It would take some
parsing to make it all work, but not impossible.

I can add it to the "to-do" list for a rainy day :-)


On Nov 6, 2009, at 7:59 AM, Paul Kapinos wrote:

> Dear OpenMPI developer,
>
> with the -x option of mpiexec there is a way to distribute
> environmnet variables:
>
> -x   Export  the  specified  environment  variables  to the
> remote
> nodes before executing the  program.
>
>
> Is there an environment variable ( OMPI_) with the same meaning?
> The writing of environmnet variables on the command line is ugly and
> tedious...
>
> I've searched for this info on OpenMPI web pages for about an hour
> and didn't find the ansver :-/
>
>
> Thanking you in anticipation,
>
> Paul
>
>
>
>
> --
> Dipl.-Inform. Paul Kapinos   -   High Performance Computing,
> RWTH Aachen University, Center for Computing and Communication
> Seffenter Weg 23,  D 52074  Aachen (Germany)
> Tel: +49 241/80-24915
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users

___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users




--
Jeff Squyres
jsquy...@cisco.com