[OMPI users] "failed to create queue pair" problem, but settings appear OK

2016-06-16 Thread Sasso, John (GE Power, Non-GE)
rank for connections (1.7+) and there are some in use by IPoIB and other services. -Nathan > On Jun 16, 2016, at 7:15 AM, Sasso, John (GE Power, Non-GE) > wrote: > > Nathan, > > Thank you for the suggestion. I tried your btl_openib_receive_queues > setting with a 4200+

[OMPI users] "failed to create queue pair" problem, but settings appear OK

2016-06-16 Thread Sasso, John (GE Power, Non-GE)
,512 to the mpirun command line. -Nathan On Jun 15, 2016, at 12:35 PM, "Sasso, John (GE Power, Non-GE)" mailto:john1.sa...@ge.com>> wrote: Chuck, The per-process limits appear fine, including those for the resource mgr daemons: Limit Soft Limit Hard Limit Units Max address space

Re: [OMPI users] "failed to create queue pair" problem, but settings appear OK

2016-06-15 Thread Sasso, John (GE Power, Non-GE)
QUESTION: Since the error said the system may have run out of queue pairs, how do I determine the # of queue pairs the IB HCA can support? -Original Message- From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Sasso, John (GE Power, Non-GE) Sent: Wednesday, June 15, 2016 2

[OMPI users] "failed to create queue pair" problem, but settings appear OK

2016-06-15 Thread Sasso, John (GE Power, Non-GE)
Od46RRA&e= I hope this helps, Gus Correa On 06/15/2016 11:05 AM, Sasso, John (GE Power, Non-GE) wrote: > > In doing testing with IMB, I find that running a 4200+ core case with > the IMB test Alltoall, and message le

[OMPI users] "failed to create queue pair" problem, but settings appear OK

2016-06-15 Thread Sasso, John (GE Power, Non-GE)
In doing testing with IMB, I find that running a 4200+ core case with the IMB test Alltoall, and message lengths of 16..1024 bytes (as per -msglog 4:10 IMB option), it fails with: -- A process failed to create a queue pair.

Re: [OMPI users] Singleton process spawns additional thread

2016-01-07 Thread Sasso, John (GE Power, Non-GE)
Stefan, I don't know if this is related to your issue, but FYI... > Those are async progress threads - they block unless something requires doing > > >> On Apr 15, 2015, at 8:36 AM, Sasso, John (GE Power & Water, Non-GE) >> wrote: >> >> I stumbled upon something while using 'ps -eFL' to view