Re: [OMPI users] Help on getting CMA works

2015-02-24 Thread Nathan Hjelm
I don't know the reasoning for requiring --with-cma to enable CMA but I am looking at auto-detecting CMA instead of requiring Open MPI to be configured with --with-cma. This will likely go into the 1.9 release series and not 1.8. -Nathan On Thu, Feb 19, 2015 at 09:31:43PM -0500, Eric Chamberland

Re: [OMPI users] Help on getting CMA works

2015-02-19 Thread Eric Chamberland
Maybe it is a stupid question, but... why it is not tested and enabled by default at configure time since it is part of the kernel? Eric On 02/19/2015 03:53 PM, Nathan Hjelm wrote: Great! I will add an MCA variable to force CMA and also enable it if 1) no yama and 2) no PR_SET_PTRACER. You m

Re: [OMPI users] Help on getting CMA works

2015-02-19 Thread Nathan Hjelm
Aurélien, I should also point out your fix has already been applied to the 1.8 branch and will be included in 1.8.5. -Nathan On Thu, Feb 19, 2015 at 02:57:38PM -0700, Nathan Hjelm wrote: > > Hmm, wait. Yes. Your change went in after 1.8.4 and has the same > effect. If yama ins't installed it is

Re: [OMPI users] Help on getting CMA works

2015-02-19 Thread Nathan Hjelm
Hmm, wait. Yes. Your change went in after 1.8.4 and has the same effect. If yama ins't installed it is safe to assume that the ptrace scope is effectively 0. So, your patch does fix the issue. -Nathan On Thu, Feb 19, 2015 at 02:53:47PM -0700, Nathan Hjelm wrote: > > I don't think that will fix

Re: [OMPI users] Help on getting CMA works

2015-02-19 Thread Nathan Hjelm
I don't think that will fix this issue. In this case yama is not installed and it appears PR_SET_PTRACER is not available. This forces vader to assume that CMA can not be used when that isn't always the case. I think it might be safe to assume that CMA is unrestricted here. -Nathan On Thu, Feb 1

Re: [OMPI users] Help on getting CMA works

2015-02-19 Thread Aurélien Bouteiller
Nathan, I think I already pushed a patch for this particular issue last month. I do not know if it has been back ported to release yet. See here:https://github.com/open-mpi/ompi/commit/ee3b0903164898750137d3b71a8f067e16521102 Aurelien -- ~~~ Aurélien Bouteiller, Ph.D. ~~~

Re: [OMPI users] Help on getting CMA works

2015-02-19 Thread Eric Chamberland
On 02/19/2015 03:53 PM, Nathan Hjelm wrote: Great! I will add an MCA variable to force CMA and also enable it if 1) no yama and 2) no PR_SET_PTRACER. cool, thanks again! You might also look at using xpmem. You can find a version that supports 3.x @ https://github.com/hjelmn/xpmem . It is a

Re: [OMPI users] Help on getting CMA works

2015-02-19 Thread Nathan Hjelm
Great! I will add an MCA variable to force CMA and also enable it if 1) no yama and 2) no PR_SET_PTRACER. You might also look at using xpmem. You can find a version that supports 3.x @ https://github.com/hjelmn/xpmem . It is a kernel module + userspace library that can be used by vader as a singl

Re: [OMPI users] Help on getting CMA works

2015-02-19 Thread Eric Chamberland
On 02/19/2015 02:58 PM, Nathan Hjelm wrote: On Thu, Feb 19, 2015 at 12:16:49PM -0500, Eric Chamberland wrote: On 02/19/2015 11:56 AM, Nathan Hjelm wrote: If you have yama installed you can try: Nope, I do not have it installed... is it absolutely necessary? (and would it change something wh

Re: [OMPI users] Help on getting CMA works

2015-02-19 Thread Nathan Hjelm
On Thu, Feb 19, 2015 at 12:16:49PM -0500, Eric Chamberland wrote: > > On 02/19/2015 11:56 AM, Nathan Hjelm wrote: > > > >If you have yama installed you can try: > > Nope, I do not have it installed... is it absolutely necessary? (and would > it change something when it fails when I am root?) > >

Re: [OMPI users] Help on getting CMA works

2015-02-19 Thread Eric Chamberland
On 02/19/2015 11:56 AM, Nathan Hjelm wrote: If you have yama installed you can try: Nope, I do not have it installed... is it absolutely necessary? (and would it change something when it fails when I am root?) Other question: In addition to "--with-cma" configure flag, do we have to pass

Re: [OMPI users] Help on getting CMA works

2015-02-19 Thread Nathan Hjelm
If you have yama installed you can try: echo 1 > /proc/sys/kernel/yama/ptrace_scope as root. -Nathan On Thu, Feb 19, 2015 at 11:06:09AM -0500, Eric Chamberland wrote: > By the way, > > I have tried two others things: > > #1- I launched it as root: > > mpiexec --mca mca_btl_vader_single_copy

Re: [OMPI users] Help on getting CMA works

2015-02-19 Thread Eric Chamberland
By the way, I have tried two others things: #1- I launched it as root: mpiexec --mca mca_btl_vader_single_copy_mechanism cma --allow-run-as-root -np 2 ./hw #2- Found this (http://askubuntu.com/questions/146160/what-is-the-ptrace-scope-workaround-for-wine-programs-and-are-there-any-risks) a

Re: [OMPI users] Help on getting CMA works

2015-02-18 Thread Éric Chamberland
Le 2015-02-18 15:14, Nathan Hjelm a écrit : I recommend using vader for CMA. It has code to get around the ptrace setting. Run with mca_btl_vader_single_copy_mechanism cma (should be the default). Ok, I tried it, but it gives exactly the same error message! Eric -Nathan On Wed, Feb 18, 2015

Re: [OMPI users] Help on getting CMA works

2015-02-18 Thread Nathan Hjelm
I recommend using vader for CMA. It has code to get around the ptrace setting. Run with mca_btl_vader_single_copy_mechanism cma (should be the default). -Nathan On Wed, Feb 18, 2015 at 02:56:01PM -0500, Eric Chamberland wrote: > Hi, > > I have configured with "--with-cma" on 2 differents OS (Re

[OMPI users] Help on getting CMA works

2015-02-18 Thread Eric Chamberland
Hi, I have configured with "--with-cma" on 2 differents OS (RedHat 6.6 and OpenSuse 12.3), but in both case, I have the following error when launching a simple mpi_hello_world.c example: /opt/openmpi-1.8.4_cma/bin/mpiexec --mca btl_sm_use_cma 1 -np 2 /tmp/hw --