Re: [OMPI users] OpenMPI fails with np > 65

2014-08-13 Thread Lenny Verkhovsky
le: +972 54 554 0233 Fax:+972 72 257 9400 From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Lenny Verkhovsky Sent: Tuesday, August 12, 2014 1:13 PM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI fails with np > 65 Hi, Config: ./configure --enable-openib-rdmacm-ib

Re: [OMPI users] OpenMPI fails with np > 65

2014-08-12 Thread Jeff Squyres (jsquyres)
288 > > > > Lenny Verkhovsky > SW Engineer, Mellanox Technologies > www.mellanox.com > > Office:+972 74 712 9244 > Mobile: +972 54 554 0233 > Fax:+972 72 257 9400 > > From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Ralph C

Re: [OMPI users] OpenMPI fails with np > 65

2014-08-12 Thread Lenny Verkhovsky
257 9400 From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Ralph Castain Sent: Monday, August 11, 2014 4:53 PM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI fails with np > 65 Okay, let's start with the basics :-) How was this configured? What environment are you running

Re: [OMPI users] OpenMPI fails with np > 65

2014-08-11 Thread Ralph Castain
Technologies > www.mellanox.com > > Office:+972 74 712 9244 > Mobile: +972 54 554 0233 > Fax:+972 72 257 9400 > > From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Ralph Castain > Sent: Monday, August 11, 2014 1:07 AM > To: Open MPI Users > Subject:

Re: [OMPI users] OpenMPI fails with np > 65

2014-08-11 Thread Lenny Verkhovsky
.mellanox.com> Office:+972 74 712 9244 Mobile: +972 54 554 0233 Fax:+972 72 257 9400 From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Ralph Castain Sent: Monday, August 11, 2014 1:07 AM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI fails with np > 65 Looks to me lik

Re: [OMPI users] OpenMPI fails with np > 65

2014-08-10 Thread Ralph Castain
Looks to me like your 65th host is missing the dstore library - is it possible you don't have your paths set correctly on all hosts in your hostfile? On Aug 10, 2014, at 1:13 PM, Lenny Verkhovsky wrote: > Hi all, > > Trying to run OpenMPI ( trunk Revision: 32428 ) I faced the problem running

[OMPI users] OpenMPI fails with np > 65

2014-08-10 Thread Lenny Verkhovsky
Hi all, Trying to run OpenMPI ( trunk Revision: 32428 ) I faced the problem running OMPI with more than 65 procs. It looks like MPI failes to open 66th connection even with running `hostname` over tcp. It also seems to unrelated to specific host. All hosts are Ubuntu 12.04.1 LTS mpirun -np 66 -