[OMPI users] Firewall settings for MPI communication

[Ping Wang]

I'm using Open MPI 1.6.5 to run OpenFOAM in parallel on several VMs on a cloud. 
mpirun hangs without any error messages. I think this is a firewall issue. 
Because when I open all the TCP ports(1-65535) in the security group of VMs, 
mpirun works well. However I was suggested to open as less ports as possible. 
So I have to limit MPI to run on a range of ports. I opened the port range 
49990-50010 for MPI communication. And use command



mpirun --mca oob_tcp_dynamic_ports 49990-50010 -np 4 --hostfile machines 
simpleFoam -parallel.



But it still hangs. How can I specify a port range that OpenMPI will use? I 
appreciate any help you can provide.



Best,

Ping Wang



ascs_logo_300dpi

--

Ping Wang

Automotive Simulation Center Stuttgart e.V.

Nobelstraße 15

D-70569 Stuttgart

Telefon: +49 711 699659-14

Fax: +49 711 699659-29

E-Mail:   ping.w...@asc-s.de

Web:   http://www.asc-s.de

Social Media:   facebook/asc.stuttgart

--

Re: [OMPI users] Firewall settings for MPI communication

[Gilles Gouaillardet]

which network are your VMs using for communications ?
if this is tcp, then you also have to specify a restricted set of allowed
ports for the tcp btl

that would be something like
mpirun --mca btl_tcp_dynamic_ports 49990-50010 ...

please double check the Open MPI 1.6.5 parameter and syntax with
ompi_info --all
(or check the archives, I think I posted the correct command line a few
weeks ago)

Cheers,

Gilles

On Wednesday, June 1, 2016, Ping Wang  wrote:

> I'm using Open MPI 1.6.5 to run OpenFOAM in parallel on several VMs on a
> cloud. mpirun hangs without any error messages. I think this is a firewall
> issue. Because when I open all the TCP ports(1-65535) in the security group
> of VMs, mpirun works well. However I was suggested to open as less ports as
> possible. So I have to limit MPI to run on a range of ports. I opened the
> port range 49990-50010 for MPI communication. And use command
>
>
>
> mpirun --mca oob_tcp_dynamic_ports 49990-50010 -np 4 --hostfile machines
> simpleFoam –parallel.
>
>
>
> But it still hangs. How can I specify a port range that OpenMPI will use?
> I appreciate any help you can provide.
>
>
>
> Best,
>
> Ping Wang
>
>
>
> [image: ascs_logo_300dpi]
>
> *--*
>
> Ping Wang
>
> *Automotive Simulation Center Stuttgart e.V.*
>
> Nobelstraße 15
>
> D-70569 Stuttgart
>
> Telefon: +49 711 699659-14
>
> Fax: +49 711 699659-29
>
> E-Mail: ping.w...@asc-s.de
> 
>
> Web: http://www.asc-s.de
>
> Social Media: [image: facebook]/asc.stuttgart
> 
>
> *--*
>
>
>
>
>

Re: [OMPI users] users Digest, Vol 3514, Issue 1

[Megdich Islem]

Hi!
Thank you Jeff for you suggestion. But, I am still not able to understand what 
do you mean by using absolute path names to for mpicc/mpifort-mpirun/mpiexec ?
This is how my .bashrc looks like
source /opt/openfoam30/etc/bashrc
export PATH=/home/Desktop/mpich/bin:$PATHexport 
LD_LIBRARY_PATH="/home/islem/Desktop/mpich/lib/:$LD_LIBRARY_PATH"export 
MPICH_F90=gfortranexport MPICH_CC=/opt/intel/bin/iccexport 
MPICH_CXX=/opt/intel/bin/icpcexport MPICH_LINK_CXX="-L/home/Desktop/mpich/lib/ 
-Wl,-rpath -Wl,/home/islem/Desktop/mpich/lib -lmpichcxx -lmpich -lopa -lmpl 
-lrt -lpthread"
export 
PATH=$PATH:/opt/intel/bin/LD_LIBRARY_PATH="/opt/intel/lib/intel64:$LD_LIBRARY_PATH"export
 LD_LIBRARY_PATHsource 
/opt/intel/compilers_and_libraries_2016.3.210/linux/mpi/intel64/mpivars.sh 
intel64
alias startEMPIRE=". /home/islem/software/empire/EMPIRE-Core/etc/bashrc.sh ICC"
mpirun --version gives mpich 3.0.4
This is how I run one example that couples 2 clients through the server 
EMPIRE.I use three terminals, in each I write one of these command lines
mpiexec -np 1 Emperor emperorInput.xml  (I got a message in the terminal saying 
that Empire started)
mpiexec -np 1 dummyCSM dummyCSMInput (I get a message that Emperor acknowledged 
connection)mpiexec -np 1 pimpleDyMFoam -case OF (I got no message in the 
terminal which means no connection)
How can I use the mpirun and where to right any modifications ?
Regards,Islem 

Le Vendredi 27 mai 2016 17h00, "users-requ...@open-mpi.org" 
 a écrit :
 

 Send users mailing list submissions to
    us...@open-mpi.org

To subscribe or unsubscribe via the World Wide Web, visit
    https://www.open-mpi.org/mailman/listinfo.cgi/users
or, via email, send a message with subject or body 'help' to
    users-requ...@open-mpi.org

You can reach the person managing the list at
    users-ow...@open-mpi.org

When replying, please edit your Subject line so it is more specific
than "Re: Contents of users digest..."


Today's Topics:

  1. Re: users Digest, Vol 3510, Issue 2 (Jeff Squyres (jsquyres))
  2. Re: segmentation fault for slot-list and openmpi-1.10.3rc2
      (Siegmar Gross)
  3. OpenMPI virtualization aware (Marco D'Amico)
  4. Re: OpenMPI virtualization aware (Ralph Castain)


--

Message: 1
List-Post: users@lists.open-mpi.org
Date: Thu, 26 May 2016 23:28:17 +
From: "Jeff Squyres (jsquyres)" 
To: Megdich Islem , "Open MPI User's List"
    
Cc: Dave Love 
Subject: Re: [OMPI users] users Digest, Vol 3510, Issue 2
Message-ID: <441f803d-fdbb-443d-82aa-74ff3845a...@cisco.com>
Content-Type: text/plain; charset="utf-8"

You're still intermingling your Open MPI and MPICH installations.

You need to ensure to use the wrapper compilers and mpirun/mpiexec from the 
same MPI implementation.

For example, if you use mpicc/mpifort from Open MPI to build your program, then 
you must use Open MPI's mpirun/mpiexec.

If you absolutely need to have both MPI implementations in your PATH / 
LD_LIBRARY_PATH, you might want to use absolute path names to for 
mpicc/mpifort/mpirun/mpiexec.



> On May 26, 2016, at 3:46 PM, Megdich Islem  wrote:
> 
> Thank you all for your suggestions !!
> 
> I found an answer to a similar case in Open MPI FAQ (Question 15)
> FAQ: Running MPI jobs
>  
>  
> 
>  
>  
>  
>  
>  
> FAQ: Running MPI jobs
> Table of contents: What pre-requisites are necessary for running an Open MPI 
> job? What ABI guarantees does Open MPI provide? Do I need a common filesystem 
> on a...
> Afficher sur www.open-mpi.org
> Aper?u par Yahoo
>  
> which suggests to use mpirun's  prefix command line option or to use the 
> mpirun wrapper.
> 
> I modified my command  to the following
>  mpirun --prefix 
>/opt/openfoam30/platforms/linux64GccDPInt32Opt/lib/Openmpi-system -np 1 
>pimpleDyMFoam -case OF
> 
> But, I got an error (see attached picture). Is the syntax correct? How can I 
> solve the problem? That first method seems to be easier than using the mpirun 
> wrapper.
> 
> Otherwise, how can I use the mpirun wrapper?
> 
> Regards,
> islem
> 
> 
> Le Mercredi 25 mai 2016 16h40, Dave Love  a ?crit :
> 
> 
> I wrote:
> 
> 
> > You could wrap one (set of) program(s) in a script to set the
> > appropriate environment before invoking the real program. 
> 
> 
> I realize I should have said something like "program invocations",
> i.e. if you have no control over something invoking mpirun for programs
> using different MPIs, then an mpirun wrapper needs to check what it's
> being asked to run.
> 
> 
> 
> ___
> users mailing list
> us...@open-mpi.org
> Subscription: https://www.open-mpi.org/mailman/listinfo.cgi/users
> Link to this post: 
> http://www.open-mpi.org/community/lists/users/2016/05/29317.php


-- 
Jeff Squyres
jsquy...@cisco.com
For corporate legal information go to: 
http://www.cisco.com/web/about/doing_business/legal/cri/


--

Message: 2
List-Post: user

Re: [OMPI users] Firewall settings for MPI communication

[Jeff Squyres (jsquyres)]

In addition, you might want to consider upgrading to Open MPI v1.10.x (v1.6.x 
is fairly ancient).

> On Jun 1, 2016, at 7:46 AM, Gilles Gouaillardet 
>  wrote:
> 
> which network are your VMs using for communications ?
> if this is tcp, then you also have to specify a restricted set of allowed 
> ports for the tcp btl
> 
> that would be something like
> mpirun --mca btl_tcp_dynamic_ports 49990-50010 ...
> 
> please double check the Open MPI 1.6.5 parameter and syntax with
> ompi_info --all
> (or check the archives, I think I posted the correct command line a few weeks 
> ago)
> 
> Cheers,
> 
> Gilles
> 
> On Wednesday, June 1, 2016, Ping Wang  wrote:
> I'm using Open MPI 1.6.5 to run OpenFOAM in parallel on several VMs on a 
> cloud. mpirun hangs without any error messages. I think this is a firewall 
> issue. Because when I open all the TCP ports(1-65535) in the security group 
> of VMs, mpirun works well. However I was suggested to open as less ports as 
> possible. So I have to limit MPI to run on a range of ports. I opened the 
> port range 49990-50010 for MPI communication. And use command
> 
>  
> 
> mpirun --mca oob_tcp_dynamic_ports 49990-50010 -np 4 --hostfile machines 
> simpleFoam –parallel. 
> 
>  
> 
> But it still hangs. How can I specify a port range that OpenMPI will use? I 
> appreciate any help you can provide.
> 
>  
> 
> Best,
> 
> Ping Wang
> 
>  
> 
> 
> 
> --
> 
> Ping Wang
> 
> Automotive Simulation Center Stuttgart e.V.
> 
> Nobelstraße 15
> 
> D-70569 Stuttgart
> 
> Telefon: +49 711 699659-14
> 
> Fax: +49 711 699659-29
> 
> E-Mail: ping.w...@asc-s.de
> 
> Web: http://www.asc-s.de
> 
> Social Media: /asc.stuttgart
> 
> --
> 
>  
> 
>  
> 
> ___
> users mailing list
> us...@open-mpi.org
> Subscription: https://www.open-mpi.org/mailman/listinfo.cgi/users
> Link to this post: 
> http://www.open-mpi.org/community/lists/users/2016/06/29340.php


-- 
Jeff Squyres
jsquy...@cisco.com
For corporate legal information go to: 
http://www.cisco.com/web/about/doing_business/legal/cri/

Re: [OMPI users] users Digest, Vol 3514, Issue 1

[Jeff Squyres (jsquyres)]

The example you list below has all MPICH paths -- I don't see any Open MPI 
setups in there.

What I was suggesting was that if you absolutely need to have both Open MPI and 
MPICH installed and in your PATH / LD_LIBRARY_PATH / MANPATH, then you can use 
the full, absolute path name to each of the Open MPI executables -- e.g., 
/path/to/openmpi/install/bin/mpicc, etc.  That way, you can use Open MPI's 
mpicc without having it in your path.

Additionally, per https://www.open-mpi.org/faq/?category=running#mpirun-prefix, 
if you specify the absolute path name to mpirun (or mpiexec -- they're 
identical in Open MPI) and you're using the rsh/ssh launcher in Open MPI, then 
Open MPI will set the right PATH / LD_LIBRARY_PATH on remote servers for you.  
See the FAQ link for more detail.



> On Jun 1, 2016, at 8:41 AM, Megdich Islem  wrote:
> 
> Hi!
> 
> Thank you Jeff for you suggestion. But, I am still not able to understand 
> what do you mean by using absolute path names to for 
> mpicc/mpifort-mpirun/mpiexec ?
> 
> This is how my .bashrc looks like
> 
> source /opt/openfoam30/etc/bashrc
> 
> export PATH=/home/Desktop/mpich/bin:$PATH
> export LD_LIBRARY_PATH="/home/islem/Desktop/mpich/lib/:$LD_LIBRARY_PATH"
> export MPICH_F90=gfortran
> export MPICH_CC=/opt/intel/bin/icc
> export MPICH_CXX=/opt/intel/bin/icpc
> export MPICH_LINK_CXX="-L/home/Desktop/mpich/lib/ -Wl,-rpath 
> -Wl,/home/islem/Desktop/mpich/lib -lmpichcxx -lmpich -lopa -lmpl -lrt 
> -lpthread"
> 
> export PATH=$PATH:/opt/intel/bin/
> LD_LIBRARY_PATH="/opt/intel/lib/intel64:$LD_LIBRARY_PATH"
> export LD_LIBRARY_PATH
> source 
> /opt/intel/compilers_and_libraries_2016.3.210/linux/mpi/intel64/mpivars.sh 
> intel64
> 
> alias startEMPIRE=". /home/islem/software/empire/EMPIRE-Core/etc/bashrc.sh 
> ICC"
> 
> mpirun --version gives mpich 3.0.4
> 
> This is how I run one example that couples 2 clients through the server 
> EMPIRE.
> I use three terminals, in each I write one of these command lines
> 
> mpiexec -np 1 Emperor emperorInput.xml  (I got a message in the terminal 
> saying that Empire started)
> 
> mpiexec -np 1 dummyCSM dummyCSMInput (I get a message that Emperor 
> acknowledged connection)
> mpiexec -np 1 pimpleDyMFoam -case OF (I got no message in the terminal which 
> means no connection)
> 
> How can I use the mpirun and where to right any modifications ?
> 
> Regards,
> Islem
> 
> 
> Le Vendredi 27 mai 2016 17h00, "users-requ...@open-mpi.org" 
>  a écrit :
> 
> 
> Send users mailing list submissions to
> us...@open-mpi.org
> 
> To subscribe or unsubscribe via the World Wide Web, visit
> https://www.open-mpi.org/mailman/listinfo.cgi/users
> or, via email, send a message with subject or body 'help' to
> users-requ...@open-mpi.org
> 
> You can reach the person managing the list at
> users-ow...@open-mpi.org
> 
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of users digest..."
> 
> 
> Today's Topics:
> 
>   1. Re: users Digest, Vol 3510, Issue 2 (Jeff Squyres (jsquyres))
>   2. Re: segmentation fault for slot-list and openmpi-1.10.3rc2
>   (Siegmar Gross)
>   3. OpenMPI virtualization aware (Marco D'Amico)
>   4. Re: OpenMPI virtualization aware (Ralph Castain)
> 
> 
> --
> 
> Message: 1
> Date: Thu, 26 May 2016 23:28:17 +
> From: "Jeff Squyres (jsquyres)" 
> To: Megdich Islem , "Open MPI User's List"
> 
> Cc: Dave Love 
> Subject: Re: [OMPI users] users Digest, Vol 3510, Issue 2
> Message-ID: <441f803d-fdbb-443d-82aa-74ff3845a...@cisco.com>
> Content-Type: text/plain; charset="utf-8"
> 
> You're still intermingling your Open MPI and MPICH installations.
> 
> You need to ensure to use the wrapper compilers and mpirun/mpiexec from the 
> same MPI implementation.
> 
> For example, if you use mpicc/mpifort from Open MPI to build your program, 
> then you must use Open MPI's mpirun/mpiexec.
> 
> If you absolutely need to have both MPI implementations in your PATH / 
> LD_LIBRARY_PATH, you might want to use absolute path names to for 
> mpicc/mpifort/mpirun/mpiexec.
> 
> 
> 
> > On May 26, 2016, at 3:46 PM, Megdich Islem  wrote:
> > 
> > Thank you all for your suggestions !!
> > 
> > I found an answer to a similar case in Open MPI FAQ (Question 15)
> > FAQ: Running MPI jobs
> >  
> >  
> > 
> >  
> >  
> >  
> >  
> >  
> > FAQ: Running MPI jobs
> > Table of contents: What pre-requisites are necessary for running an Open 
> > MPI job? What ABI guarantees does Open MPI provide? Do I need a common 
> > filesystem on a...
> > Afficher sur www.open-mpi.org
> > Aper?u par Yahoo
> >  
> > which suggests to use mpirun's  prefix command line option or to use the 
> > mpirun wrapper.
> > 
> > I modified my command  to the following
> >  mpirun --prefix 
> > /opt/openfoam30/platforms/linux64GccDPInt32Opt/lib/Openmpi-system -np 1 
> > pimpleDyMFoam -case OF
> > 
> > But, I got an error (see attached picture). Is the sy

Re: [OMPI users] users Digest, Vol 3518, Issue 2

[Megdich Islem]

Hi!
Thank you Jeff. I was able to run a case of OF  by setting the absolute path 
name  for mpiexec. But, when I wanted to run a coupled case in which  OF is 
coupled with dummyCSM through EMPIRE using these three command lines:
mpiexec -np 1 Emperor emperorInput.xml
mpiexec -np 1 dummyCSM dummyCSMInput
mpiexec -np 1 pimpleDyMFoam -case OF,

I was still getting OF not able to connect. In the user guide of EMPIRE, it is 
said that emperor (the client)  has to recognize the clients which are dummyCSM 
and OpenFOAM. For some reasons emperor is not able to recognize OpenFoam but it 
recognizes dummyCSM. 
What can be the cause that a server can not recognize a client ?
Regards,Islem 

Le Mercredi 1 juin 2016 17h00, "users-requ...@open-mpi.org" 
 a écrit :
 

 Send users mailing list submissions to
    us...@open-mpi.org

To subscribe or unsubscribe via the World Wide Web, visit
    https://www.open-mpi.org/mailman/listinfo.cgi/users
or, via email, send a message with subject or body 'help' to
    users-requ...@open-mpi.org

You can reach the person managing the list at
    users-ow...@open-mpi.org

When replying, please edit your Subject line so it is more specific
than "Re: Contents of users digest..."


Today's Topics:

  1. Re: Firewall settings for MPI communication
      (Jeff Squyres (jsquyres))
  2. Re: users Digest, Vol 3514, Issue 1 (Jeff Squyres (jsquyres))


--

Message: 1
List-Post: users@lists.open-mpi.org
Date: Wed, 1 Jun 2016 13:02:22 +
From: "Jeff Squyres (jsquyres)" 
To: "Open MPI User's List" 
Subject: Re: [OMPI users] Firewall settings for MPI communication
Message-ID: 
Content-Type: text/plain; charset="utf-8"

In addition, you might want to consider upgrading to Open MPI v1.10.x (v1.6.x 
is fairly ancient).

> On Jun 1, 2016, at 7:46 AM, Gilles Gouaillardet 
>  wrote:
> 
> which network are your VMs using for communications ?
> if this is tcp, then you also have to specify a restricted set of allowed 
> ports for the tcp btl
> 
> that would be something like
> mpirun --mca btl_tcp_dynamic_ports 49990-50010 ...
> 
> please double check the Open MPI 1.6.5 parameter and syntax with
> ompi_info --all
> (or check the archives, I think I posted the correct command line a few weeks 
> ago)
> 
> Cheers,
> 
> Gilles
> 
> On Wednesday, June 1, 2016, Ping Wang  wrote:
> I'm using Open MPI 1.6.5 to run OpenFOAM in parallel on several VMs on a 
> cloud. mpirun hangs without any error messages. I think this is a firewall 
> issue. Because when I open all the TCP ports(1-65535) in the security group 
> of VMs, mpirun works well. However I was suggested to open as less ports as 
> possible. So I have to limit MPI to run on a range of ports. I opened the 
> port range 49990-50010 for MPI communication. And use command
> 
>  
> 
> mpirun --mca oob_tcp_dynamic_ports 49990-50010 -np 4 --hostfile machines 
> simpleFoam ?parallel. 
> 
>  
> 
> But it still hangs. How can I specify a port range that OpenMPI will use? I 
> appreciate any help you can provide.
> 
>  
> 
> Best,
> 
> Ping Wang
> 
>  
> 
> 
> 
> --
> 
> Ping Wang
> 
> Automotive Simulation Center Stuttgart e.V.
> 
> Nobelstra?e 15
> 
> D-70569 Stuttgart
> 
> Telefon: +49 711 699659-14
> 
> Fax: +49 711 699659-29
> 
> E-Mail: ping.w...@asc-s.de
> 
> Web: http://www.asc-s.de
> 
> Social Media: /asc.stuttgart
> 
> --
> 
>  
> 
>  
> 
> ___
> users mailing list
> us...@open-mpi.org
> Subscription: https://www.open-mpi.org/mailman/listinfo.cgi/users
> Link to this post: 
> http://www.open-mpi.org/community/lists/users/2016/06/29340.php


-- 
Jeff Squyres
jsquy...@cisco.com
For corporate legal information go to: 
http://www.cisco.com/web/about/doing_business/legal/cri/


--

Message: 2
List-Post: users@lists.open-mpi.org
Date: Wed, 1 Jun 2016 13:51:55 +
From: "Jeff Squyres (jsquyres)" 
To: Megdich Islem , "Open MPI User's List"
    
Subject: Re: [OMPI users] users Digest, Vol 3514, Issue 1
Message-ID: 
Content-Type: text/plain; charset="utf-8"

The example you list below has all MPICH paths -- I don't see any Open MPI 
setups in there.

What I was suggesting was that if you absolutely need to have both Open MPI and 
MPICH installed and in your PATH / LD_LIBRARY_PATH / MANPATH, then you can use 
the full, absolute path name to each of the Open MPI executables -- e.g., 
/path/to/openmpi/install/bin/mpicc, etc.  That way, you can use Open MPI's 
mpicc without having it in your path.

Additionally, per https://www.open-mpi.org/faq/?category=running#mpirun-prefix, 
if you specify the absolute path name to mpirun (or mpiexec -- they're 
identical in Open MPI) and you're using the rsh/ssh launcher in Open MPI, then 
Open MPI will set the right PATH / LD_LIBRARY_PATH on remote servers for you.  
See the FAQ link 

Re: [OMPI users] users Digest, Vol 3518, Issue 2

[Jeff Squyres (jsquyres)]

I'm afraid I don't know much about OpenFoam.  You'll likely need to ask 
assistance from the OpenFoam community.


> On Jun 1, 2016, at 6:13 PM, Megdich Islem  wrote:
> 
> Hi!
> 
> Thank you Jeff. I was able to run a case of OF  by setting the absolute path 
> name  for mpiexec. But, when I wanted to run a coupled case in which  OF is 
> coupled with dummyCSM through EMPIRE using these three command lines:
> 
> mpiexec -np 1 Emperor emperorInput.xml
> mpiexec -np 1 dummyCSM dummyCSMInput
> mpiexec -np 1 pimpleDyMFoam -case OF,
> 
> I was still getting OF not able to connect. In the user guide of EMPIRE, it 
> is said that emperor (the client)  has to recognize the clients which are 
> dummyCSM and OpenFOAM. For some reasons emperor is not able to recognize 
> OpenFoam but it recognizes dummyCSM. 
> 
> What can be the cause that a server can not recognize a client ?
> 
> Regards,
> Islem
> 
> 
> Le Mercredi 1 juin 2016 17h00, "users-requ...@open-mpi.org" 
>  a écrit :
> 
> 
> Send users mailing list submissions to
> us...@open-mpi.org
> 
> To subscribe or unsubscribe via the World Wide Web, visit
> https://www.open-mpi.org/mailman/listinfo.cgi/users
> or, via email, send a message with subject or body 'help' to
> users-requ...@open-mpi.org
> 
> You can reach the person managing the list at
> users-ow...@open-mpi.org
> 
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of users digest..."
> 
> 
> Today's Topics:
> 
>   1. Re: Firewall settings for MPI communication
>   (Jeff Squyres (jsquyres))
>   2. Re: users Digest, Vol 3514, Issue 1 (Jeff Squyres (jsquyres))
> 
> 
> --
> 
> Message: 1
> Date: Wed, 1 Jun 2016 13:02:22 +
> From: "Jeff Squyres (jsquyres)" 
> To: "Open MPI User's List" 
> Subject: Re: [OMPI users] Firewall settings for MPI communication
> Message-ID: 
> Content-Type: text/plain; charset="utf-8"
> 
> In addition, you might want to consider upgrading to Open MPI v1.10.x (v1.6.x 
> is fairly ancient).
> 
> > On Jun 1, 2016, at 7:46 AM, Gilles Gouaillardet 
> >  wrote:
> > 
> > which network are your VMs using for communications ?
> > if this is tcp, then you also have to specify a restricted set of allowed 
> > ports for the tcp btl
> > 
> > that would be something like
> > mpirun --mca btl_tcp_dynamic_ports 49990-50010 ...
> > 
> > please double check the Open MPI 1.6.5 parameter and syntax with
> > ompi_info --all
> > (or check the archives, I think I posted the correct command line a few 
> > weeks ago)
> > 
> > Cheers,
> > 
> > Gilles
> > 
> > On Wednesday, June 1, 2016, Ping Wang  wrote:
> > I'm using Open MPI 1.6.5 to run OpenFOAM in parallel on several VMs on a 
> > cloud. mpirun hangs without any error messages. I think this is a firewall 
> > issue. Because when I open all the TCP ports(1-65535) in the security group 
> > of VMs, mpirun works well. However I was suggested to open as less ports as 
> > possible. So I have to limit MPI to run on a range of ports. I opened the 
> > port range 49990-50010 for MPI communication. And use command
> > 
> >  
> > 
> > mpirun --mca oob_tcp_dynamic_ports 49990-50010 -np 4 --hostfile machines 
> > simpleFoam ?parallel. 
> > 
> >  
> > 
> > But it still hangs. How can I specify a port range that OpenMPI will use? I 
> > appreciate any help you can provide.
> > 
> >  
> > 
> > Best,
> > 
> > Ping Wang
> > 
> >  
> > 
> > 
> > 
> > --
> > 
> > Ping Wang
> > 
> > Automotive Simulation Center Stuttgart e.V.
> > 
> > Nobelstra?e 15
> > 
> > D-70569 Stuttgart
> > 
> > Telefon: +49 711 699659-14
> > 
> > Fax: +49 711 699659-29
> > 
> > E-Mail: ping.w...@asc-s.de
> > 
> > Web: http://www.asc-s.de
> > 
> > Social Media: /asc.stuttgart
> > 
> > --
> > 
> >  
> > 
> >  
> > 
> > ___
> > users mailing list
> > us...@open-mpi.org
> > Subscription: https://www.open-mpi.org/mailman/listinfo.cgi/users
> > Link to this post: 
> > http://www.open-mpi.org/community/lists/users/2016/06/29340.php
> 
> 
> -- 
> Jeff Squyres
> jsquy...@cisco.com
> For corporate legal information go to: 
> http://www.cisco.com/web/about/doing_business/legal/cri/
> 
> 
> --
> 
> Message: 2
> Date: Wed, 1 Jun 2016 13:51:55 +
> From: "Jeff Squyres (jsquyres)" 
> To: Megdich Islem , "Open MPI User's List"
> 
> Subject: Re: [OMPI users] users Digest, Vol 3514, Issue 1
> Message-ID: 
> Content-Type: text/plain; charset="utf-8"
> 
> The example you list below has all MPICH paths -- I don't see any Open MPI 
> setups in there.
> 
> What I was suggesting was that if you absolutely need to have both Open MPI 
> and MPICH installed and in your PATH / LD_LIBRARY_PATH / MANPATH, then you 
> can use the full, absolute path name to each of the Open MPI executables -- 
> e.g., /path/to/openmpi