[OMPI users] tuning sm/vader for large messages

2017-03-17 Thread Joshua Mora
Hello, I am trying to get the max bw for shared memory communications using osu_[bw,bibw,mbw_mr] benchmarks. I am observing a peak at ~64k/128K msg size and then drops instead of sustaining it. What parameters or linux config do I need to add to default openmpi settings to get this improved ? I am

Re: [OMPI users] tuning sm/vader for large messages

2017-03-17 Thread Joshua Mora
ss placement and the size of the different cache levels. In your > particular case I guess after 128k you are outside the L2 cache (1/2 of the > cache in fact) and the bandwidth will drop as the data need to be flushed > to main memory. > > George. > > > > On Fri, Mar

Re: [OMPI users] tuning sm/vader for large messages

2017-03-20 Thread Joshua Mora
. Thanks, Joshua -- Original Message -- Received: 03:06 PM CDT, 03/17/2017 From: George Bosilca To: Joshua Mora Cc: Open MPI Users Subject: Re: [OMPI users] tuning sm/vader for large messages > On Fri, Mar 17, 2017 at 3:33 PM, Joshua Mora wrote: > > > Thanks f

Re: [OMPI users] tuning sm/vader for large messages

2017-03-20 Thread Joshua Mora
osilca  To: Joshua Mora  Cc: Open MPI Users  Subject: Re: [OMPI users] tuning sm/vader for large messages > On Mon, Mar 20, 2017 at 12:45 PM, Joshua Mora wrote: > > > If at certain x msg size you achieve X performance (MB/s) and at 2x msg > > size > > or higher

Re: [OMPI users] single CPU vs four CPU result differences, is it normal?

2015-10-28 Thread Joshua Mora
Diego. Assuming you are not properly coding the solver. Write a problem so you know the exact solution. That is know A (a very simple non singular SDP) and x_ , where x_ !=0. Make x a linear function or a constant so it is super easy to spot where it is happening the bad x's. I assume A has the bou