Re: [OMPI users] [EXTERNAL] Re: How to find MPI ranks located in remote nodes?

2014-11-25 Thread Teranishi, Keita
is located - not sure if there is an MPI API for accessing it, though. On Nov 25, 2014, at 2:32 PM, Teranishi, Keita mailto:knte...@sandia.gov>> wrote: Hi, I am trying to figure out a way for each local MPI rank to identify the ranks located in physically remote nodes (just different

[OMPI users] How to find MPI ranks located in remote nodes?

2014-11-25 Thread Teranishi, Keita
Hi, I am trying to figure out a way for each local MPI rank to identify the ranks located in physically remote nodes (just different nodes) of cluster or MPPs such as Cray. I am using MPI_Get_processor_name to get the node ID, but it requires some processing to map MPI rank to the node ID. I

Re: [OMPI users] [EXTERNAL] Re: (OpenMPI for Cray XE6 ) How to set mca parameters through aprun?

2013-12-02 Thread Teranishi, Keita
;enable_orte_static_ports=yes > > >That should work. > >-Nathan > >On Wed, Nov 27, 2013 at 08:05:48PM +, Teranishi, Keita wrote: >> Nathan, >> >> I got a compile-time error (see below). I use a script from >> contrib/platform/lanl/cray_xe6 with gcc-4.7.2.

Re: [OMPI users] [EXTERNAL] Re: (OpenMPI for Cray XE6 ) How to set mca parameters through aprun?

2013-11-27 Thread Teranishi, Keita
l-recursive] Error 1 make[1]: Leaving directory `/ufs/home/knteran/openmpi-1.7.3/orte' On 11/26/13 3:54 PM, "Nathan Hjelm" wrote: >Alright, everything is identical to Cielito but it looks like you are >getting >bad data from alps. > >I think we changed some of the

Re: [OMPI users] [EXTERNAL] Re: (OpenMPI for Cray XE6 ) How to set mca parameters through aprun?

2013-11-26 Thread Teranishi, Keita
des.) > >-Nathan > >On Tue, Nov 26, 2013 at 11:07:36PM +, Teranishi, Keita wrote: >> Nathan, >> >> Here it is. >> >> Keita >> >> >> >> >> >> On 11/26/13 3:02 PM, "Nathan Hjelm" wrote: >> >&g

Re: [OMPI users] [EXTERNAL] Re: (OpenMPI for Cray XE6 ) How to set mca parameters through aprun?

2013-11-26 Thread Teranishi, Keita
_verbose 100 . That way I can see what was read from >alps. > >-Nathan > >On Tue, Nov 26, 2013 at 10:14:11PM +, Teranishi, Keita wrote: >> Nathan, >> >> I am hoping these files would help you. >> >> Thanks, >> Keita >> >> >>

Re: [OMPI users] [EXTERNAL] Re: (OpenMPI for Cray XE6 ) How to set mca parameters through aprun?

2013-11-26 Thread Teranishi, Keita
pper. > >-Nathan Hjelm >Application Readiness, HPC-5, LANL > >On Tue, Nov 26, 2013 at 09:33:20PM +, Teranishi, Keita wrote: >> Nathan, >> >> Please see the attached o

Re: [OMPI users] [EXTERNAL] Re: (OpenMPI for Cray XE6 ) How to set mca parameters through aprun?

2013-11-26 Thread Teranishi, Keita
m >Application Readiness, HPC-5, LANL > >On Tue, Nov 26, 2013 at 09:18:14PM +, Teranishi, Keita wrote: >> Nathan, >> >> Now I remove strip_prefix stuff, which was applied to the other versions >> of OpenMPI. >> I still have the same problem with msubrun

Re: [OMPI users] [EXTERNAL] Re: (OpenMPI for Cray XE6 ) How to set mca parameters through aprun?

2013-11-26 Thread Teranishi, Keita
will confuse orte since the node hostname will not match what >was >supplied by alps. > >-Nathan > >On Tue, Nov 26, 2013 at 08:38:51PM +, Teranishi, Keita wrote: >> Nathan, >> >> (Please forget about the segfault. It was my mistake). >> I use OpenMPI-1.

Re: [OMPI users] [EXTERNAL] Re: (OpenMPI for Cray XE6 ) How to set mca parameters through aprun?

2013-11-26 Thread Teranishi, Keita
32 ./bcast >App launch reported: 17 (out of 3) daemons - 0 (out of 32) procs >ct-login1:/lscratch1/hjelmn/ibm/collective hjelmn$ > > >How did you configure Open MPI and what version are you using? > >-Nathan > >On Mon, Nov 25, 2013 at 08:48:09PM +, Teranishi, Keita w

Re: [OMPI users] [EXTERNAL] Re: (OpenMPI for Cray XE6 ) How to set mca parameters through aprun?

2013-11-25 Thread Teranishi, Keita
;> ===== >> >> >> Torque also shows only one node with 16 PPN: >> >> $ env | grep PBS >> ... >> PBS_NUM_PPN=16 >> >> >> $ cat /var/spool/torque/aux//915289.sdb >> login

Re: [OMPI users] [EXTERNAL] Re: (OpenMPI for Cray XE6 ) How to set mca parameters through aprun?

2013-11-23 Thread Teranishi, Keita
y - since you are using qsub, can I assume you have Moab as your scheduler? aprun should be forwarding the envars - do you see them if you just run "aprun -n 1 printenv"? On Nov 23, 2013, at 2:13 PM, Teranishi, Keita mailto:knte...@sandia.gov>> wrote: Hi, I installed OpenMPI

[OMPI users] (OpenMPI for Cray XE6 ) How to set mca parameters through aprun?

2013-11-23 Thread Teranishi, Keita
Hi, I installed OpenMPI on our small XE6 using the configure options under /contrib directory. It appears it is working fine, but it ignores MCA parameters (set in env var). So I switched to mpirun (in OpenMPI) and it can handle MCA parameters somehow. However, mpirun fails to allocate proc

Re: [OMPI users] [EXTERNAL] Re: What version of PMI (Cray XE6) is working for OpenMPI-1.6.5?

2013-09-03 Thread Teranishi, Keita
0. > >32) PrgEnv-gnu/4.1.40 > >We have not yet fully tested Open MPI on CLE 5.x.x. > >-Nathan Hjelm >HPC-3, LANL > >On Tue, Sep 03, 2013 at 10:33:57PM +, Teranishi, Keita wrote: >> Hi, >> >> Here is what I put in my PBS script to allocate only si

Re: [OMPI users] [EXTERNAL] Re: What version of PMI (Cray XE6) is working for OpenMPI-1.6.5?

2013-09-03 Thread Teranishi, Keita
s? > > >On Sep 3, 2013, at 1:38 PM, "Teranishi, Keita" wrote: > >> It is what I got. >> >> >>- >>- >> There are not enough slots available in the system to satisfy t

Re: [OMPI users] [EXTERNAL] Re: What version of PMI (Cray XE6) is working for OpenMPI-1.6.5?

2013-09-03 Thread Teranishi, Keita
make more slots available for use. -- Thanks, Keita On 9/3/13 1:26 PM, "Ralph Castain" wrote: >How does it fail? > >On Sep 3, 2013, at 1:19 PM, "Teranishi, Keita" wrote: > >> Nathan, &g

Re: [OMPI users] [EXTERNAL] Re: What version of PMI (Cray XE6) is working for OpenMPI-1.6.5?

2013-09-03 Thread Teranishi, Keita
either PrgEnv-gnu or PrgEnv-intel. The PGI compiler can be >a PIA. It is possible to build with the Cray compiler but it takes >patching the config.guess and changing some autoconf stuff. > >-Nathan > >Please excuse the horrible Outlook-style quoting. >__________

Re: [OMPI users] [EXTERNAL] Re: What version of PMI (Cray XE6) is working for OpenMPI-1.6.5?

2013-08-29 Thread Teranishi, Keita
Thanks for the info. Is it still possible to build by myself? What is the procedure other than configure script? On 8/23/13 2:37 PM, "Nathan Hjelm" wrote: >On Fri, Aug 23, 2013 at 09:14:25PM +0000, Teranishi, Keita wrote: >>Hi, >>I am trying to install

[OMPI users] What version of PMI (Cray XE6) is working for OpenMPI-1.6.5?

2013-08-23 Thread Teranishi, Keita
Hi, I am trying to install OpenMPI 1.6.5 on Cray XE6 and very curious with the current support of PMI. In the previous discussions, there was a comment on the version of PMI (it works with 2.1.4, but fails with 3.0). Our machine has PMI2.1.4 and PMI4.0 (default). Which version do you recomme