Re: [OMPI users] runtime performance tuning for Intel OMA interconnect

2016-08-11 Thread Xiaolong Cui
n Behalf Of > *Xiaolong > Cui > *Sent:* Thursday, August 11, 2016 2:13 PM > > *To:* Open MPI Users > *Subject:* Re: [OMPI users] runtime performance tuning for Intel OMA > interconnect > > > > Sorry, forgot the attachments. > > > > On Thu, Aug 11, 2016

Re: [OMPI users] runtime performance tuning for Intel OMA interconnect

2016-08-11 Thread Cabral, Matias A
...@lists.open-mpi.org] On Behalf Of Xiaolong Cui Sent: Thursday, August 11, 2016 2:13 PM To: Open MPI Users Subject: Re: [OMPI users] runtime performance tuning for Intel OMA interconnect Sorry, forgot the attachments. On Thu, Aug 11, 2016 at 5:06 PM, Xiaolong Cui mailto:sunshine...@gmail.com

Re: [OMPI users] runtime performance tuning for Intel OMA interconnect

2016-08-11 Thread Xiaolong Cui
ESH -> Largest supported >> value. >> >> >> >> Regards, >> >> >> >> _MAC >> >> >> >> *From:* users [mailto:users-boun...@lists.open-mpi.org] *On Behalf Of >> *Xiaolong >> Cui >> *Sent:* Wednesday,

Re: [OMPI users] runtime performance tuning for Intel OMA interconnect

2016-08-11 Thread Xiaolong Cui
PSM2_MQ_RNDV_HFI_THRESH -> Largest supported > value. > > > > Regards, > > > > _MAC > > > > *From:* users [mailto:users-boun...@lists.open-mpi.org] *On Behalf Of > *Xiaolong > Cui > *Sent:* Wednesday, August 10, 2016 7:19 PM > *To:* Open MPI Users

Re: [OMPI users] runtime performance tuning for Intel OMA interconnect

2016-08-10 Thread Cabral, Matias A
Open MPI Users Subject: Re: [OMPI users] runtime performance tuning for Intel OMA interconnect Hi Matias, Thanks a lot, that's very helpful! What I need indeed is to always use eager mode. But I didn't find any information about PSM2_MQ_EAGER_SDMA_SZ online. Would you please elaborat

Re: [OMPI users] runtime performance tuning for Intel OMA interconnect

2016-08-10 Thread Xiaolong Cui
Hi Matias, Thanks a lot, that's very helpful! What I need indeed is to always use eager mode. But I didn't find any information about PSM2_MQ_EAGER_SDMA_SZ online. Would you please elaborate on "Just in case PSM2_MQ_EAGER_SDMA_SZ changes PIO to SDMA, always in eager mode." Thanks! Michael On We

Re: [OMPI users] runtime performance tuning for Intel OMA interconnect

2016-08-10 Thread Cabral, Matias A
Hi Michael, When Open MPI run on Omni-Path it will choose the PSM2 MTL by default, to use the libpsm2.so. Strictly speaking, it has compatibility to run using the openib BTL. However, the performance so significantly impacted that it is, not only discouraged, but no tuning would make sense. Reg