[OMPI users] It's possible to get mpi working without ssh?

2018-12-19 Thread Daniel Edreira 
Hi all,

Does anyone know if there's a possibility to configure a cluster of nodes to 
communicate with each other with mpirun without using SSH?

Someone is asking me about making a cluster with Infiniband that does not use 
SSH to communicate using OpenMPI.

Thanks in advance

Regards.

AVISO LEGAL

Responsable del tratamiento: PLAIN CONCEPTS, S.L con CIF B24532178 con 
dirección AVDA. ORDOÑO II 32 1° IZDA - 24001 LEÓN con 
r...@plainconcepts.com
Finalidades: para gestionar y mantener los contactos y relaciones que se 
produzcan como consecuencia de la relación que mantiene con PLAIN CONCEPTS, S.L.
Legitimación a su consentimiento, así como para la ejecución de un contrato, 
procediendo éstos del propio interesado titular de los datos.
Destinatarios: sus datos no serán cedidos a ninguna empresa, salvo obligación 
legal. Sin embargo, para tener la máxima transparencia con usted, le indicamos 
que nuestro servicio de correo electrónico está externalizado con Office365 
(propiedad de Microsoft Corporation), pudiendo suponer una transferencia 
internacional de datos personales fuera del Espacio Económico Europeo. No 
obstante, Office365 aporta garantías suficientes al estar adherida al marco del 
Privacy Shield (más información pulsando 
aquí).
Derechos: puede acceder, rectificar y suprimir los datos, así como otros 
derechos, como se explica en la información adicional.
Confidencialidad: la información contenida en el presente correo electrónico es 
confidencial; en el supuesto de que usted no sea el destinatario autorizado, le 
rogamos borre el mensaje y nos lo comunique a la presente dirección de correo 
electrónico.
Información adicional: puede consultar la información adicional y detallada 
sobre protección de Datos en nuestra página web: 
www.plainconcepts.com/privacy/

LEGAL NOTICE

Responsible for the treatment: PLAIN CONCEPTS, S.L with CIF B24532178 and 
address AVDA. ORDOÑO II 32 1° IZDA - 24001 LEON with 
r...@plainconcepts.com
Purpose: to manage and maintain contacts and relationships that occur as a 
result of the relationship maintained with PLAIN CONCEPTS, S.L.
Legitimation to their consent, as well as for the execution of a contract, 
coming from the interested party owning the data.
Recipients: your data will not be transferred to any company, except legal 
obligation. However, in order to have maximum transparency with you, we inform 
you that our email service is outsourced with Office365 (owned by Microsoft 
Corporation), and may involve an international transfer of personal data 
outside the European Economic Area. However, Office365 provides sufficient 
guarantees by adhering to the Privacy Shield link (more information by clicking 
here).
Rights: you can access, rectify and delete the data, as well as other rights, 
as explained in the additional information.
Confidentiality: the information contained in this email is confidential; In 
the event that you are not the authorized recipient, please delete the message 
and notify us to this email address.
Additional information: you can consult the additional and detailed information 
on data protection on our website: 
www.plainconcepts.com/privacy/

___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users

Re: [OMPI users] It's possible to get mpi working without ssh?

2018-12-19 Thread Jeff Squyres (jsquyres) via users 
On Dec 19, 2018, at 11:42 AM, Daniel Edreira  wrote:
> 
> Does anyone know if there's a possibility to configure a cluster of nodes to 
> communicate with each other with mpirun without using SSH?
> 
> Someone is asking me about making a cluster with Infiniband that does not use 
> SSH to communicate using OpenMPI.

I'm not entirely clear what you're asking.  You mention both "ssh" and 
"communication" -- they're kinda different things.

Communication: Over an InfiniBand cluster, we'd recommend that you use the UCX 
library for Open MPI to communicate over IB.  I.e., when your MPI application 
invokes API calls like MPI_Send() and MPI_Recv(), they'll use the UCX library 
underneath and utilize native IB-style communication (i.e., they're not using 
the POSIX sockets API -- they're using the native UCX/verbs APIs for RDMA OS 
bypass and offload, ...etc.).

Ssh: ssh is not used for *communication*, per se; it's used for *starting Linux 
processes on remote nodes.  Open MPI can use SSH to start processes on remote 
nodes, but it can also use other mechanisms (e.g., if you have a resource 
manager such as SLURM, Open MPI can use SLURM's native remote process launching 
mechanism instead of SSH).

These two things are orthogonal to each other: you can use whatever 
*communication* mechanism you want for MPI APIs (e.g., the POSIX sockets API or 
the UCX library or ...several other APIs...), and use whatever *process launch* 
mechanism you want (e.g., SSH or SLURM's native remote process launch or 
...several others...).  Put simply: the choice of MPI communication layer does 
not imply anything about the remote process launch mechanism, and vice versa.

Make sense?

-- 
Jeff Squyres
jsquy...@cisco.com

___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users

Re: [OMPI users] It's possible to get mpi working without ssh?

2018-12-19 Thread Daniel Edreira 
Hi Jeff,



Thanks a lot for your answer, It really makes sense.



Do you know where can I find more information about the *process launch on 
remote nodes* of MPI and all the alternatives I have?



Thanks and regards.




From: users  on behalf of Jeff Squyres 
(jsquyres) via users 
Sent: Wednesday, December 19, 2018 7:18:23 PM
To: Open MPI User's List
Cc: Jeff Squyres (jsquyres)
Subject: Re: [OMPI users] It's possible to get mpi working without ssh?

On Dec 19, 2018, at 11:42 AM, Daniel Edreira  wrote:
>
> Does anyone know if there's a possibility to configure a cluster of nodes to 
> communicate with each other with mpirun without using SSH?
>
> Someone is asking me about making a cluster with Infiniband that does not use 
> SSH to communicate using OpenMPI.

I'm not entirely clear what you're asking.  You mention both "ssh" and 
"communication" -- they're kinda different things.

Communication: Over an InfiniBand cluster, we'd recommend that you use the UCX 
library for Open MPI to communicate over IB.  I.e., when your MPI application 
invokes API calls like MPI_Send() and MPI_Recv(), they'll use the UCX library 
underneath and utilize native IB-style communication (i.e., they're not using 
the POSIX sockets API -- they're using the native UCX/verbs APIs for RDMA OS 
bypass and offload, ...etc.).

Ssh: ssh is not used for *communication*, per se; it's used for *starting Linux 
processes on remote nodes.  Open MPI can use SSH to start processes on remote 
nodes, but it can also use other mechanisms (e.g., if you have a resource 
manager such as SLURM, Open MPI can use SLURM's native remote process launching 
mechanism instead of SSH).

These two things are orthogonal to each other: you can use whatever 
*communication* mechanism you want for MPI APIs (e.g., the POSIX sockets API or 
the UCX library or ...several other APIs...), and use whatever *process launch* 
mechanism you want (e.g., SSH or SLURM's native remote process launch or 
...several others...).  Put simply: the choice of MPI communication layer does 
not imply anything about the remote process launch mechanism, and vice versa.

Make sense?

--
Jeff Squyres
jsquy...@cisco.com

___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users
___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users