Re: [OMPI users] Avoiding the memory registration costs by having memory always registered, is it possible with Linux ?

2016-06-27 Thread Audet, Martin
Thanks Jeff and Alex for your answers and comments. mlockall(), especially with the MCL_FUTURE argument is indeed interesting. Thanks Jeff for your clarification of what memory registration really means (e.g. locking and telling the network stack the virtual to physical mapping). Also concernin

Re: [OMPI users] Avoiding the memory registration costs by having memory always registered, is it possible with Linux ?

2016-06-27 Thread Brice Goglin
mlock() and mlockall() only guarantee that pages won't be swapped out to the disk. However, they don't prevent virtual pages from moving to other physical pages (for instance during migration between NUMA nodes), which breaks memory registration. At least this was true a couple years ago, I didn't

Re: [OMPI users] Avoiding the memory registration costs by having memory always registered, is it possible with Linux ?

2016-06-27 Thread Jeff Squyres (jsquyres)
Brice: good to know. Martin: yes, we should update README. Thanks for the heads up. > On Jun 27, 2016, at 3:24 PM, Brice Goglin wrote: > > mlock() and mlockall() only guarantee that pages won't be swapped out to the > disk. However, they don't prevent virtual pages from moving to other physi

[OMPI users] Experience with MXM, yalla, FCA and HCOLL with Mellanox HCA ?

2016-06-27 Thread Audet, Martin
Hi Open MPI Users and Developers, I would like to know your experience with the optional middleware and the corresponding Open MPI framework/components for recent Mellanox Infiniband HCA, especially concerning MXM, FCA (the latest versions bring HCOLL I think) and the related Open MPI framework

Re: [OMPI users] FORTH and MPI

2016-06-27 Thread Richard C. Wagner
John: that does sound very interesting! As others have said - haven't heard of FORTH for many years, As I recall there was a UK PC programmed in FORTH. The Dragon I think. I've been using Forth in scientific applications and control systems since 1989. Take a look at my website, http://www.