Re: [OMPI users] Hints for running OpenMPI on Intel/Phi (MIC) enabled hosts

2013-10-14 Thread Ralph Castain
Looping back to this thread: I just added the required locality infrastructure to support OMPI's direct use of the SCIF interface, and Nathan has a branch with the required BTL. So we should have full Phi support shortly, and it will be included in the 1.7.4 release. We'll send out an announcem

Re: [OMPI users] btl_tcp_if_include setting

2013-10-14 Thread Jeff Squyres (jsquyres)
Perhaps Nathan can comment on the status of the native Gemini work in Open MPI... On Oct 14, 2013, at 11:40 AM, Ray Sheppard wrote: > Hi Jeff, > On the Cray are two modes. ESM is the preferred method but some packages > require the CCM (cluster compatibility mode). In ESM, MPI is transparen

Re: [OMPI users] btl_tcp_if_include setting

2013-10-14 Thread Ray Sheppard
Hi Jeff, On the Cray are two modes. ESM is the preferred method but some packages require the CCM (cluster compatibility mode). In ESM, MPI is transparent and works great. In CCM, an external MPI is needed. There is supposed to a translator to make the Gemini switch look like IB, but it do

Re: [OMPI users] btl_tcp_if_include setting

2013-10-14 Thread Jeff Squyres (jsquyres)
Just curious -- why are you using the TCP transport on a Cray? On Oct 14, 2013, at 11:00 AM, Ray Sheppard wrote: > Thanks Ralph, Thanks Jeff, > I should have written sooner. I spent the weekend trying to set it as a > configure option. > Ray > > > On 10/14/2013 10:

Re: [OMPI users] btl_tcp_if_include setting

2013-10-14 Thread Ray Sheppard
Thanks Ralph, Thanks Jeff, I should have written sooner. I spent the weekend trying to set it as a configure option. Ray On 10/14/2013 10:42 AM, Jeff Squyres (jsquyres) wrote: More info on Ralph's comment is available here: http://www.open-mpi.org/faq/?categ

Re: [OMPI users] btl_tcp_if_include setting

2013-10-14 Thread Jeff Squyres (jsquyres)
More info on Ralph's comment is available here: http://www.open-mpi.org/faq/?category=tuning#setting-mca-params On Oct 14, 2013, at 10:36 AM, Ralph Castain wrote: > It won't be a configure switch, but you can put the following in your default > system mca param file: > > btl_tcp_if_inclu

Re: [OMPI users] btl_tcp_if_include setting

2013-10-14 Thread Ralph Castain
It won't be a configure switch, but you can put the following in your default system mca param file: btl_tcp_if_include=ipogif0 You'll find that file in /etc - it is called openmpi-mca-params.conf. Users won't have to enter it after that since we pick that file up by default. On Oct 14, 2013,

[OMPI users] btl_tcp_if_include setting

2013-10-14 Thread Ray Sheppard
Hi, I am setting up version 1.7.2 for a Cray XE-6. The build nodes have different interfaces than the compute nodes. I have been able to set it up, but users need to embed the following into their mpirun command: --mca btl_tcp_if_include ipogif0 Currently, The ompi_info shows as below. I h

Re: [OMPI users] Need help running jobs across different IB vendors

2013-10-14 Thread Kevin M. Hildebrand
Yes, the same version of OpenMPI (1.6.5) is running on all of the machines, verified via 'mpirun --version' and also checked library paths via 'ldd'. Non-MPI programs work fine. Kevin List-Post: users@lists.open-mpi.org Date: Fri, 11 Oct 2013 20:06:22 + From: "Jeff Squyres (jsquyres)" 1.