Re: [OMPI users] Running mpirun with grid

2020-06-02 Thread Kulshrestha, Vipul via users
From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of John Hearns via users Sent: Tuesday, June 2, 2020 2:25 AM To: Open MPI Users Cc: John Hearns Subject: Re: [OMPI users] Running mpirun with grid As a suggestion can we see the configuration of your Parallel Environment? qconf -spl

Re: [OMPI users] Running mpirun with grid

2020-06-02 Thread Gilles Gouaillardet via users
; > [26562,1] > > [sox3:24416] [[26562,0],0] plm:base:receive update proc state command from > > [[26562,0],4] > > [sox3:24416] [[26562,0],0] plm:base:receive got update_proc_state for job > > [26562,1] > > [sox3:24416] [[26562,0],0] plm:base:receive update proc state com

Re: [OMPI users] Running mpirun with grid

2020-06-01 Thread John Hearns via users
; job [26562,1] > > [sox3:24416] [[26562,0],0] plm:base:receive update proc state command > from [[26562,0],1] > > [sox3:24416] [[26562,0],0] plm:base:receive got update_proc_state for > job [26562,1] > > [sox3:24416] [[26562,0],0] plm:base:receive update proc state command &

Re: [OMPI users] Running mpirun with grid

2020-06-01 Thread Ralph Castain via users
[[26562,0],1] > [sox3:24416] [[26562,0],0] plm:base:receive got update_proc_state for job > [26562,1] > [sox3:24416] [[26562,0],0] plm:base:receive update proc state command from > [[26562,0],2] > [sox3:24416] [[26562,0],0] plm:base:receive got update_proc_state for job > [26

Re: [OMPI users] Running mpirun with grid

2020-06-01 Thread Kulshrestha, Vipul via users
m:base:receive update proc state command from [[26562,0],3] [sox3:24416] [[26562,0],0] plm:base:receive got update_proc_state for job [26562,1] -Original Message- From: Jeff Squyres (jsquyres) [mailto:jsquy...@cisco.com] Sent: Monday, June 1, 2020 4:15 PM To: Open MPI User's List Cc: K

Re: [OMPI users] Running mpirun with grid

2020-06-01 Thread Jeff Squyres (jsquyres) via users
On top of what Ralph said, I think that this output is unexpected: > Starting server daemon at host "cod5"Starting server daemon at host > "cod6"Starting server daemon at host "has4"Starting server daemon at host "co > d4" > > > > Starting server daemon at host "hpb12"Starting server daemon at

Re: [OMPI users] Running mpirun with grid

2020-06-01 Thread Ralph Castain via users
on network interfaces and/or no route found between > them. Please check network connectivity (including firewalls > and network routing requirements). > -- >

Re: [OMPI users] Running mpirun with grid

2020-05-31 Thread Kulshrestha, Vipul via users
s). -- ------------------ -Original Message- From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Ralph Castain via users Sent: Sund

Re: [OMPI users] Running mpirun with grid

2020-05-31 Thread Kulshrestha, Vipul via users
Cc: John Hearns Subject: Re: [OMPI users] Running mpirun with grid Good morning Vipul. I would like to ask some higher level questions regarding your HPC cluster. What are the manufacturers of the cluster nodes. How many compute nodes? What network interconnect do you have - gigabit ethernet

Re: [OMPI users] Running mpirun with grid

2020-05-31 Thread Ralph Castain via users
The messages about the daemons is coming from two different sources. Grid is saying it was able to spawn the orted - then the orted is saying it doesn't know how to communicate and fails. I think the root of the problem lies in the plm output that shows the qrsh it will use to start the job. Fo

Re: [OMPI users] Running mpirun with grid

2020-05-29 Thread Gilles Gouaillardet via users
John, Most of these questions are irrelevant with respect to the resolution of this problem. Please use this mailing list only for Open MPI related topics. Cheers, Gilles On Sat, May 30, 2020 at 3:24 PM John Hearns via users wrote: > > Good morning Vipul. I would like to ask some higher leve

Re: [OMPI users] Running mpirun with grid

2020-05-29 Thread John Hearns via users
Good morning Vipul. I would like to ask some higher level questions regarding your HPC cluster. What are the manufacturers of the cluster nodes. How many compute nodes? What network interconnect do you have - gigabit ethernet, 10gig ethernet, Infiniband, Omnipath? Which cluster middleware - openHPC

Re: [OMPI users] running mpirun with grid

2020-03-24 Thread Kulshrestha, Vipul via users
I can get on this. Thanks, Vipul -Original Message- From: Kulshrestha, Vipul Sent: Thursday, March 19, 2020 5:31 PM To: 'Reuti' ; Open MPI Users Subject: RE: [OMPI users] running mpirun with grid Hi Reuti, Finally I was able to understand how to set this up and I have so

Re: [OMPI users] running mpirun with grid

2020-03-19 Thread Kulshrestha, Vipul via users
message to the specified daemon located on the indicated node: my node: bos2 target node: hpb11 This is usually an internal programming error that should be reported to the developers. In the meantime, a workaround may be to set the MCA param routed=direct on the command line or in your environment. We apologi

Re: [OMPI users] running mpirun with grid

2020-02-06 Thread Kulshrestha, Vipul via users
: Thursday, February 6, 2020 4:35 PM To: Open MPI Users Cc: Kulshrestha, Vipul Subject: Re: [OMPI users] running mpirun with grid Hi, > Am 06.02.2020 um 21:47 schrieb Kulshrestha, Vipul via users > : > > Hi, > > I need to launch my openmpi application on grid. > > My ap

Re: [OMPI users] running mpirun with grid

2020-02-06 Thread Reuti via users
Hi, > Am 06.02.2020 um 21:47 schrieb Kulshrestha, Vipul via users > : > > Hi, > > I need to launch my openmpi application on grid. > > My application is designed to run N processes, where each process would have > M threads. > > To run it without grid, I run it as (say N = 7, M = 2) > % m