[OMPI users] MPI_T Control Variables
Hi, I am new to the MPI_T interface, and was trying to run an applications developed by LLNL which queries and lists the values of the control variables available. The tool can be downloaded from the following site: https://computation-rnd.llnl.gov/mpi_t/varList.php I noticed that when I ran the tool, I would encounter the following error: [c557-604:121075] Signal: Segmentation fault (11) [c557-604:121075] Signal code: Invalid permissions (2) [c557-604:121075] Failing at address: 0x2b54ce9d1418 [c557-604:121075] [ 0] /lib64/libpthread.so.0[0x397060f710] [c557-604:121075] [ 1] /work/02282/esthela/MPI/install-openmpi-1.8.1/lib/libmpi.so.1(MPI_T_cvar_read+0xc6)[0x2b54cbe55bd6] [c557-604:121075] [ 2] ./varlist(list_cvars+0xda7)[0x402e17] [c557-604:121075] [ 3] ./varlist(main+0x347)[0x401e37] [c557-604:121075] [ 4] /lib64/libc.so.6(__libc_start_main+0xfd)[0x396fe1ed1d] [c557-604:121075] [ 5] ./varlist[0x401a29] [c557-604:121075] *** End of error message *** I went ahead and tried to write a code that follows the process in varlist to read the control variables, and encountered the same error when I called the following function: err=MPI_T_cvar_read(handle,val); Through a recommendation, I ran both my code and the tool using mvapich, and could not reproduce the error. I don't know if this is a bug or if I didn't configure my installation of OpenMPI correctly. Below is a script that I used to install OpenMPI: set -e rm -fr /work/02282/esthela/MPI/install-openmpi-1.8.1 && \ make clean && \ ./configure --with-cma=yes --prefix=/work/02282/esthela/MPI/install-openmpi-1.8.1 \ CC=icc CXX=icpc FC=ifort --enable-shared CFLAGS="-O3 -ip -xHost" \ CXXFLAGS="-O3 -ip -xHost" --without-slurm --disable-vt --with-verbs=/opt/ofed \ --with-verbs-libdir=/opt/ofed/lib64 && \ make clean && \ make -j4 && \ make install? Help in resolving this issue would be greatly appreciated. Thank you! Esthela Gallardo
Re: [OMPI users] MPI_T Control Variables
Can you try with a 1.8.2 nightly tarball or the trunk? I fixed a couple of bugs that varlist discovered (also found some in varlist). -Nathan Hjelm HPC-5, LANL On Fri, Jul 11, 2014 at 04:42:01PM +, Gallardo, Esthela wrote: >Hi, > >I am new to the MPI_T interface, and was trying to run an applications >developed by LLNL which queries and lists the values of the control >variables available. The tool can be downloaded from the following site: > >https://computation-rnd.llnl.gov/mpi_t/varList.php > >I noticed that when I ran the tool, I would encounter the following >error: > >[c557-604:121075] Signal: Segmentation fault (11) >[c557-604:121075] Signal code: Invalid permissions (2) >[c557-604:121075] Failing at address: 0x2b54ce9d1418 >[c557-604:121075] [ 0] /lib64/libpthread.so.0[0x397060f710] >[c557-604:121075] [ 1] > > /work/02282/esthela/MPI/install-openmpi-1.8.1/lib/libmpi.so.1(MPI_T_cvar_read+0xc6)[0x2b54cbe55bd6] >[c557-604:121075] [ 2] ./varlist(list_cvars+0xda7)[0x402e17] >[c557-604:121075] [ 3] ./varlist(main+0x347)[0x401e37] >[c557-604:121075] [ 4] >/lib64/libc.so.6(__libc_start_main+0xfd)[0x396fe1ed1d] >[c557-604:121075] [ 5] ./varlist[0x401a29] >[c557-604:121075] *** End of error message *** >I went ahead and tried to write a code that follows the process in varlist >to read the control variables, and encountered the same error when I >called the following function: >err=MPI_T_cvar_read(handle,val); > >Through a recommendation, I ran both my code and the tool using mvapich, >and could not reproduce the error. I don't know if this is a bug or if I >didn't configure my installation of OpenMPI correctly. Below is a script >that I used to install OpenMPI: > >set -e >rm -fr /work/02282/esthela/MPI/install-openmpi-1.8.1 && \ >make clean && \ >./configure --with-cma=yes >--prefix=/work/02282/esthela/MPI/install-openmpi-1.8.1 \ >CC=icc CXX=icpc FC=ifort --enable-shared CFLAGS="-O3 -ip -xHost" \ >CXXFLAGS="-O3 -ip -xHost" --without-slurm --disable-vt >--with-verbs=/opt/ofed \ >--with-verbs-libdir=/opt/ofed/lib64 && \ >make clean && \ >make -j4 && \ >make install > > > >Help in resolving this issue would be greatly appreciated. > >Thank you! > >Esthela Gallardo > ___ > users mailing list > us...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > Link to this post: > http://www.open-mpi.org/community/lists/users/2014/07/24758.php pgp1cgAKLKwD6.pgp Description: PGP signature
Re: [OMPI users] MPI_T Control Variables
Hi Nathan, Where can I access the 1.8.2 tarball? I'm not sure if you meant to include it as an attachment. If so, then it did not go through. Thank you, Esthela Gallardo From: users on behalf of Nathan Hjelm Sent: Friday, July 11, 2014 10:50 AM To: Open MPI Users Subject: Re: [OMPI users] MPI_T Control Variables Can you try with a 1.8.2 nightly tarball or the trunk? I fixed a couple of bugs that varlist discovered (also found some in varlist). -Nathan Hjelm HPC-5, LANL On Fri, Jul 11, 2014 at 04:42:01PM +, Gallardo, Esthela wrote: >Hi, > >I am new to the MPI_T interface, and was trying to run an applications >developed by LLNL which queries and lists the values of the control >variables available. The tool can be downloaded from the following site: > >https://computation-rnd.llnl.gov/mpi_t/varList.php > >I noticed that when I ran the tool, I would encounter the following >error: > >[c557-604:121075] Signal: Segmentation fault (11) >[c557-604:121075] Signal code: Invalid permissions (2) >[c557-604:121075] Failing at address: 0x2b54ce9d1418 >[c557-604:121075] [ 0] /lib64/libpthread.so.0[0x397060f710] >[c557-604:121075] [ 1] > > /work/02282/esthela/MPI/install-openmpi-1.8.1/lib/libmpi.so.1(MPI_T_cvar_read+0xc6)[0x2b54cbe55bd6] >[c557-604:121075] [ 2] ./varlist(list_cvars+0xda7)[0x402e17] >[c557-604:121075] [ 3] ./varlist(main+0x347)[0x401e37] >[c557-604:121075] [ 4] >/lib64/libc.so.6(__libc_start_main+0xfd)[0x396fe1ed1d] >[c557-604:121075] [ 5] ./varlist[0x401a29] >[c557-604:121075] *** End of error message *** >I went ahead and tried to write a code that follows the process in varlist >to read the control variables, and encountered the same error when I >called the following function: >err=MPI_T_cvar_read(handle,val); > >Through a recommendation, I ran both my code and the tool using mvapich, >and could not reproduce the error. I don't know if this is a bug or if I >didn't configure my installation of OpenMPI correctly. Below is a script >that I used to install OpenMPI: > >set -e >rm -fr /work/02282/esthela/MPI/install-openmpi-1.8.1 && \ >make clean && \ >./configure --with-cma=yes >--prefix=/work/02282/esthela/MPI/install-openmpi-1.8.1 \ >CC=icc CXX=icpc FC=ifort --enable-shared CFLAGS="-O3 -ip -xHost" \ >CXXFLAGS="-O3 -ip -xHost" --without-slurm --disable-vt >--with-verbs=/opt/ofed \ >--with-verbs-libdir=/opt/ofed/lib64 && \ >make clean && \ >make -j4 && \ >make install > > > >Help in resolving this issue would be greatly appreciated. > >Thank you! > >Esthela Gallardo > ___ > users mailing list > us...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > Link to this post: > http://www.open-mpi.org/community/lists/users/2014/07/24758.php
Re: [OMPI users] MPI_T Control Variables
The current nightly tarball can be found at http://www.open-mpi.org/nightly/v1.8/openmpi-1.8.2a1r32209.tar.gz -Nathan Hjelm HPC-5, LANL On Fri, Jul 11, 2014 at 05:04:07PM +, Gallardo, Esthela wrote: > Hi Nathan, > > Where can I access the 1.8.2 tarball? I'm not sure if you meant to include it > as an attachment. If so, then it did not go through. > > Thank you, > > Esthela Gallardo > > From: users on behalf of Nathan Hjelm > > Sent: Friday, July 11, 2014 10:50 AM > To: Open MPI Users > Subject: Re: [OMPI users] MPI_T Control Variables > > Can you try with a 1.8.2 nightly tarball or the trunk? I fixed a couple > of bugs that varlist discovered (also found some in varlist). > > -Nathan Hjelm > HPC-5, LANL > > On Fri, Jul 11, 2014 at 04:42:01PM +, Gallardo, Esthela wrote: > >Hi, > > > >I am new to the MPI_T interface, and was trying to run an applications > >developed by LLNL which queries and lists the values of the control > >variables available. The tool can be downloaded from the following site: > > > >https://computation-rnd.llnl.gov/mpi_t/varList.php > > > >I noticed that when I ran the tool, I would encounter the following > >error: > > > >[c557-604:121075] Signal: Segmentation fault (11) > >[c557-604:121075] Signal code: Invalid permissions (2) > >[c557-604:121075] Failing at address: 0x2b54ce9d1418 > >[c557-604:121075] [ 0] /lib64/libpthread.so.0[0x397060f710] > >[c557-604:121075] [ 1] > > > > /work/02282/esthela/MPI/install-openmpi-1.8.1/lib/libmpi.so.1(MPI_T_cvar_read+0xc6)[0x2b54cbe55bd6] > >[c557-604:121075] [ 2] ./varlist(list_cvars+0xda7)[0x402e17] > >[c557-604:121075] [ 3] ./varlist(main+0x347)[0x401e37] > >[c557-604:121075] [ 4] > >/lib64/libc.so.6(__libc_start_main+0xfd)[0x396fe1ed1d] > >[c557-604:121075] [ 5] ./varlist[0x401a29] > >[c557-604:121075] *** End of error message *** > >I went ahead and tried to write a code that follows the process in > > varlist > >to read the control variables, and encountered the same error when I > >called the following function: > >err=MPI_T_cvar_read(handle,val); > > > >Through a recommendation, I ran both my code and the tool using mvapich, > >and could not reproduce the error. I don't know if this is a bug or if I > >didn't configure my installation of OpenMPI correctly. Below is a script > >that I used to install OpenMPI: > > > >set -e > >rm -fr /work/02282/esthela/MPI/install-openmpi-1.8.1 && \ > >make clean && \ > >./configure --with-cma=yes > >--prefix=/work/02282/esthela/MPI/install-openmpi-1.8.1 \ > >CC=icc CXX=icpc FC=ifort --enable-shared CFLAGS="-O3 -ip -xHost" \ > >CXXFLAGS="-O3 -ip -xHost" --without-slurm --disable-vt > >--with-verbs=/opt/ofed \ > >--with-verbs-libdir=/opt/ofed/lib64 && \ > >make clean && \ > >make -j4 && \ > >make install > > > > > > > >Help in resolving this issue would be greatly appreciated. > > > >Thank you! > > > >Esthela Gallardo > > > ___ > > users mailing list > > us...@open-mpi.org > > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > > Link to this post: > > http://www.open-mpi.org/community/lists/users/2014/07/24758.php > ___ > users mailing list > us...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > Link to this post: > http://www.open-mpi.org/community/lists/users/2014/07/24760.php pgpBkYDXJd1Oz.pgp Description: PGP signature
Re: [OMPI users] MPI_T Control Variables
Hmm, looks like the varlist fixes I provided to LLNL haven't made it into their git repo. Use the attached version with 1.8.2. -Nathan On Fri, Jul 11, 2014 at 05:04:07PM +, Gallardo, Esthela wrote: > Hi Nathan, > > Where can I access the 1.8.2 tarball? I'm not sure if you meant to include it > as an attachment. If so, then it did not go through. > > Thank you, > > Esthela Gallardo > > From: users on behalf of Nathan Hjelm > > Sent: Friday, July 11, 2014 10:50 AM > To: Open MPI Users > Subject: Re: [OMPI users] MPI_T Control Variables > > Can you try with a 1.8.2 nightly tarball or the trunk? I fixed a couple > of bugs that varlist discovered (also found some in varlist). > > -Nathan Hjelm > HPC-5, LANL > > On Fri, Jul 11, 2014 at 04:42:01PM +, Gallardo, Esthela wrote: > >Hi, > > > >I am new to the MPI_T interface, and was trying to run an applications > >developed by LLNL which queries and lists the values of the control > >variables available. The tool can be downloaded from the following site: > > > >https://computation-rnd.llnl.gov/mpi_t/varList.php > > > >I noticed that when I ran the tool, I would encounter the following > >error: > > > >[c557-604:121075] Signal: Segmentation fault (11) > >[c557-604:121075] Signal code: Invalid permissions (2) > >[c557-604:121075] Failing at address: 0x2b54ce9d1418 > >[c557-604:121075] [ 0] /lib64/libpthread.so.0[0x397060f710] > >[c557-604:121075] [ 1] > > > > /work/02282/esthela/MPI/install-openmpi-1.8.1/lib/libmpi.so.1(MPI_T_cvar_read+0xc6)[0x2b54cbe55bd6] > >[c557-604:121075] [ 2] ./varlist(list_cvars+0xda7)[0x402e17] > >[c557-604:121075] [ 3] ./varlist(main+0x347)[0x401e37] > >[c557-604:121075] [ 4] > >/lib64/libc.so.6(__libc_start_main+0xfd)[0x396fe1ed1d] > >[c557-604:121075] [ 5] ./varlist[0x401a29] > >[c557-604:121075] *** End of error message *** > >I went ahead and tried to write a code that follows the process in > > varlist > >to read the control variables, and encountered the same error when I > >called the following function: > >err=MPI_T_cvar_read(handle,val); > > > >Through a recommendation, I ran both my code and the tool using mvapich, > >and could not reproduce the error. I don't know if this is a bug or if I > >didn't configure my installation of OpenMPI correctly. Below is a script > >that I used to install OpenMPI: > > > >set -e > >rm -fr /work/02282/esthela/MPI/install-openmpi-1.8.1 && \ > >make clean && \ > >./configure --with-cma=yes > >--prefix=/work/02282/esthela/MPI/install-openmpi-1.8.1 \ > >CC=icc CXX=icpc FC=ifort --enable-shared CFLAGS="-O3 -ip -xHost" \ > >CXXFLAGS="-O3 -ip -xHost" --without-slurm --disable-vt > >--with-verbs=/opt/ofed \ > >--with-verbs-libdir=/opt/ofed/lib64 && \ > >make clean && \ > >make -j4 && \ > >make install > > > > > > > >Help in resolving this issue would be greatly appreciated. > > > >Thank you! > > > >Esthela Gallardo > > > ___ > > users mailing list > > us...@open-mpi.org > > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > > Link to this post: > > http://www.open-mpi.org/community/lists/users/2014/07/24758.php > ___ > users mailing list > us...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > Link to this post: > http://www.open-mpi.org/community/lists/users/2014/07/24760.php #include #include #include #include #include #include #define SCREENLEN 78 #ifndef MPI_COUNT #define MPI_COUNT MPI_INT typedef int MPI_Count; #endif #ifndef MPI_T_CVAR_HANDLE_NULL #define MPI_T_CVAR_HANDLE_NULL NULL #endif #define CHECKERR(errstr,err) if (err!=MPI_SUCCESS) { printf("ERROR: %s: MPI error code %i\n",errstr,err); usage(1); } int list_pvar,list_cvar,longlist,verbosity,runmpi; #define RUNMPI 1 /* Usage */ void usage(int e) { printf("Usage: varlist [-c] [-p] [-v ] [-l] [-m]\n"); printf("-c = List only Control Variables\n"); printf("-p = List only Performance Variables\n"); printf("-v = List up to verbosity level (1=U/B to 9=D/D)\n"); printf("-l = Long list with all information, incl. descriptions\n"); printf("-m = Do not call MPI_Init before listing variables\n"); printf("-h = This help text\n"); exit(e); } /* Print a filled string */ void print_filled(char *s, int len, char c) { int i; printf("%s",s); for (i=strlen(s); imaxnamelen) maxnamelen=namelen; if (desclen>maxdesclen) maxdesclen=desclen; if (verbos<=verbosity) numvars++; } printf("Found %i performance variables with verbosity <= ",numvars); print_verbosity_short(verbosity); printf("\n\n"); /*
Re: [OMPI users] MPI_T Control Variables
Ignore that. Their version is ok. The one I have looks like it is out of date. Just tested theirs with trunk. -Nathan On Fri, Jul 11, 2014 at 11:27:42AM -0600, Nathan Hjelm wrote: > > Hmm, looks like the varlist fixes I provided to LLNL haven't made it > into their git repo. Use the attached version with 1.8.2. > > -Nathan > > On Fri, Jul 11, 2014 at 05:04:07PM +, Gallardo, Esthela wrote: > > Hi Nathan, > > > > Where can I access the 1.8.2 tarball? I'm not sure if you meant to include > > it as an attachment. If so, then it did not go through. > > > > Thank you, > > > > Esthela Gallardo > > > > From: users on behalf of Nathan Hjelm > > > > Sent: Friday, July 11, 2014 10:50 AM > > To: Open MPI Users > > Subject: Re: [OMPI users] MPI_T Control Variables > > > > Can you try with a 1.8.2 nightly tarball or the trunk? I fixed a couple > > of bugs that varlist discovered (also found some in varlist). > > > > -Nathan Hjelm > > HPC-5, LANL > > > > On Fri, Jul 11, 2014 at 04:42:01PM +, Gallardo, Esthela wrote: > > >Hi, > > > > > >I am new to the MPI_T interface, and was trying to run an applications > > >developed by LLNL which queries and lists the values of the control > > >variables available. The tool can be downloaded from the following > > > site: > > > > > >https://computation-rnd.llnl.gov/mpi_t/varList.php > > > > > >I noticed that when I ran the tool, I would encounter the following > > >error: > > > > > >[c557-604:121075] Signal: Segmentation fault (11) > > >[c557-604:121075] Signal code: Invalid permissions (2) > > >[c557-604:121075] Failing at address: 0x2b54ce9d1418 > > >[c557-604:121075] [ 0] /lib64/libpthread.so.0[0x397060f710] > > >[c557-604:121075] [ 1] > > > > > > /work/02282/esthela/MPI/install-openmpi-1.8.1/lib/libmpi.so.1(MPI_T_cvar_read+0xc6)[0x2b54cbe55bd6] > > >[c557-604:121075] [ 2] ./varlist(list_cvars+0xda7)[0x402e17] > > >[c557-604:121075] [ 3] ./varlist(main+0x347)[0x401e37] > > >[c557-604:121075] [ 4] > > >/lib64/libc.so.6(__libc_start_main+0xfd)[0x396fe1ed1d] > > >[c557-604:121075] [ 5] ./varlist[0x401a29] > > >[c557-604:121075] *** End of error message *** > > >I went ahead and tried to write a code that follows the process in > > > varlist > > >to read the control variables, and encountered the same error when I > > >called the following function: > > >err=MPI_T_cvar_read(handle,val); > > > > > >Through a recommendation, I ran both my code and the tool using > > > mvapich, > > >and could not reproduce the error. I don't know if this is a bug or if > > > I > > >didn't configure my installation of OpenMPI correctly. Below is a > > > script > > >that I used to install OpenMPI: > > > > > >set -e > > >rm -fr /work/02282/esthela/MPI/install-openmpi-1.8.1 && \ > > >make clean && \ > > >./configure --with-cma=yes > > >--prefix=/work/02282/esthela/MPI/install-openmpi-1.8.1 \ > > >CC=icc CXX=icpc FC=ifort --enable-shared CFLAGS="-O3 -ip -xHost" \ > > >CXXFLAGS="-O3 -ip -xHost" --without-slurm --disable-vt > > >--with-verbs=/opt/ofed \ > > >--with-verbs-libdir=/opt/ofed/lib64 && \ > > >make clean && \ > > >make -j4 && \ > > >make install > > > > > > > > > > > >Help in resolving this issue would be greatly appreciated. > > > > > >Thank you! > > > > > >Esthela Gallardo > > > > > ___ > > > users mailing list > > > us...@open-mpi.org > > > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > > > Link to this post: > > > http://www.open-mpi.org/community/lists/users/2014/07/24758.php > > ___ > > users mailing list > > us...@open-mpi.org > > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > > Link to this post: > > http://www.open-mpi.org/community/lists/users/2014/07/24760.php > #include > #include > #include > #include > #include > > #include > > #define SCREENLEN 78 > > #ifndef MPI_COUNT > #define MPI_COUNT MPI_INT > typedef int MPI_Count; > #endif > > #ifndef MPI_T_CVAR_HANDLE_NULL > #define MPI_T_CVAR_HANDLE_NULL NULL > #endif > > #define CHECKERR(errstr,err) if (err!=MPI_SUCCESS) { printf("ERROR: %s: MPI > error code %i\n",errstr,err); usage(1); } > > int list_pvar,list_cvar,longlist,verbosity,runmpi; > > #define RUNMPI 1 > > /* Usage */ > > void usage(int e) > { > printf("Usage: varlist [-c] [-p] [-v ] [-l] [-m]\n"); > printf("-c = List only Control Variables\n"); > printf("-p = List only Performance Variables\n"); > printf("-v = List up to verbosity level (1=U/B to 9=D/D)\n"); > printf("-l = Long list with all information, incl. descriptions\n"); > printf("-m = Do not call MPI_Init before listing variables\n"); > printf("-h = This help text\n"); >