Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-28 Thread Ralph Castain
> -Bill L. > > From: users [users-boun...@open-mpi.org] on behalf of Ralph Castain > [r...@open-mpi.org] > Sent: Friday, April 10, 2015 5:28 PM > To: Open MPI Users > Subject: Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3 > > This will be in the next nightly 1.8.5 ta

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-28 Thread Lane, William
t: Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3 This will be in the next nightly 1.8.5 tarball. Bill: can you test it to see if we’ve fixed the problem? Thanks Ralph On Apr 10, 2015, at 2:15 PM, Ralph Castain mailto:r...@open-mpi.org>> wrote: Okay, I at least now understand t

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-10 Thread Ralph Castain
0x7f7287c740c9] >> [csclprd3-0-9:27284] [ 3] >> /hpc/apps/mpi/openmpi/1.8.2/lib/libmpi.so.1(ompi_free_list_resize_mt+0x40)[0x7f7287c74200] >> [csclprd3-0-9:27284] [ 4] >> /hpc/apps/mpi/openmpi/1.8.2/lib/openmpi/mca_bml_r2.so(+0x138e)[0x7f72812c638e] >> [csclprd3-0-9:27

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-10 Thread Ralph Castain
7272] [ 6] > /hpc/apps/mpi/openmpi/1.8.2/lib/libmpi.so.1(ompi_mpi_init+0x8d6)[0x7f646af43e26] > [csclprd3-0-9:27272] [ 7] > /hpc/apps/mpi/openmpi/1.8.2/lib/libmpi.so.1(MPI_Init+0x170)[0x7f646af62e10] > [csclprd3-0-9:27272] [ 8] /hpc/apps/benchmarks/hpl/xhpl[0x401571] > [csclprd3-0-9

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-10 Thread Ralph Castain
b/openmpi/mca_pml_ob1.so(mca_pml_ob1_add_procs+0xd5)[0x7f645f5344e5] > [csclprd3-0-9:27272] [ 6] > /hpc/apps/mpi/openmpi/1.8.2/lib/libmpi.so.1(ompi_mpi_init+0x8d6)[0x7f646af43e26] > [csclprd3-0-9:27272] [ 7] > /hpc/apps/mpi/openmpi/1.8.2/lib/libmpi.so.1(MPI_Init+0x170)[0x7f646af62e10] >

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-09 Thread Lane, William
___ From: users [users-boun...@open-mpi.org] on behalf of Ralph Castain [r...@open-mpi.org] Sent: Wednesday, April 08, 2015 11:31 AM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3 Just for clarity: does the BIOS on the LGA2011 system have HT enabled?

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-08 Thread Ralph Castain
> very application dependent. Some apps appear to benefit, while others can > even suffer from it. > > I think we should support a mix of nodes in this usage, so I’ll try to come > up with a way to do so. > >> >> I'm going to go through all the OpenMPI >> a

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-08 Thread Lane, William
open-mpi.org>] on behalf of Ralph Castain [r...@open-mpi.org<mailto:r...@open-mpi.org>] Sent: Tuesday, April 07, 2015 7:32 PM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3 I’m not sure our man pages are good enough to answer your question, but here is the

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-08 Thread Ralph Castain
.@open-mpi.org] > Sent: Tuesday, April 07, 2015 7:32 PM > To: Open MPI Users > Subject: Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3 > > I’m not sure our man pages are good enough to answer your question, but here > is the URL > > http://www.open-mpi.org/doc/v1.8

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-08 Thread Ralph Castain
es numactl-devel, whether to HT or non-HT nodes > > Bill L. > > From: users [users-boun...@open-mpi.org <mailto:users-boun...@open-mpi.org>] > on behalf of Lane, William [william.l...@cshs.org > <mailto:william.l...@cshs.org>] > Sent: Wednesday, April 08, 2015 9:29

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-08 Thread Lane, William
ybe just NUMA nodes that also have hyperthreading capabilities? Bill L. From: users [users-boun...@open-mpi.org] on behalf of Lane, William [william.l...@cshs.org] Sent: Wednesday, April 08, 2015 9:29 AM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI 1.8.2

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-08 Thread Lane, William
m: users [users-boun...@open-mpi.org<mailto:users-boun...@open-mpi.org>] on behalf of Ralph Castain [r...@open-mpi.org<mailto:r...@open-mpi.org>] Sent: Monday, April 06, 2015 1:39 PM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3 Hmmm…well, that shoul

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-07 Thread Ralph Castain
ere a > URL I can I find a copy of the manpages for OpenMPI 1.8.2? > > Thanks for your help, > > -Bill Lane > > From: users [users-boun...@open-mpi.org] on behalf of Ralph Castain > [r...@open-mpi.org] > Sent: Monday, April 06, 2015 1:39 PM > To: Open MPI Users &g

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-07 Thread Lane, William
.@open-mpi.org] Sent: Monday, April 06, 2015 1:39 PM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3 Hmmm…well, that shouldn’t be the issue. To check, try running it with “bind-to none”. If you can get a backtrace telling us where it is crashing, that would a

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-06 Thread Ralph Castain
: users [users-boun...@open-mpi.org] on behalf of Ralph Castain > [r...@open-mpi.org] > Sent: Sunday, April 05, 2015 6:09 PM > To: Open MPI Users > Subject: Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3 > > >> On Apr 5, 2015, at 5:58 PM, Lane, William > <mailt

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-06 Thread Lane, William
Sent: Sunday, April 05, 2015 6:09 PM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3 On Apr 5, 2015, at 5:58 PM, Lane, William mailto:william.l...@cshs.org>> wrote: I think some of the Intel Blade systems in the cluster are dual core, but don't suppor

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-05 Thread Ralph Castain
alf of Ralph Castain > [r...@open-mpi.org] > Sent: Wednesday, April 01, 2015 8:40 AM > To: Open MPI Users > Subject: Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3 > > Bingo - you said the magic word. This is a terminology issue. When we say > "core", we mean

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-05 Thread Lane, William
Ralph. Bill L. From: users [users-boun...@open-mpi.org] on behalf of Ralph Castain [r...@open-mpi.org] Sent: Wednesday, April 01, 2015 8:40 AM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3 Bingo - you said the magic word. This i

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-01 Thread Ralph Castain
are defined > for any of the above systems. > > -Bill L. > > > -- > *From:* users [users-boun...@open-mpi.org] on behalf of Ralph Castain [ > r...@open-mpi.org] > *Sent:* Wednesday, April 01, 2015 5:04 AM > *To:* Open MPI Users > *Subject:*

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-01 Thread Lane, William
Sent: Wednesday, April 01, 2015 5:04 AM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3 The warning about binding to memory is due to not having numactl-devel installed on the system. The job would still run, but we are warning you that we cannot bind memory to the

Re: [OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-01 Thread Ralph Castain
The warning about binding to memory is due to not having numactl-devel installed on the system. The job would still run, but we are warning you that we cannot bind memory to the same domain as the core where we bind the process. Can cause poor performance, but not fatal. I forget the name of the pa

[OMPI users] OpenMPI 1.8.2 problems on CentOS 6.3

2015-04-01 Thread Lane, William
I'm having problems running OpenMPI jobs (using a hostfile) on an HPC cluster running ROCKS on CentOS 6.3. I'm running OpenMPI outside of Sun Grid Engine (i.e. it is not submitted as a job to SGE). The program being run is a LAPACK benchmark. The commandline parameter I'm using to run the jobs is: