Re: [OMPI users] busy waiting and oversubscriptions

; MKL libraries use all available hardware threads for sufficiently large data sets). -- Tim Prince

Re: [OMPI users] openMPI in 64 bit

n any indication that anyone is supporting openmpi for ifort Windows 64-bit. The closest openmpi thing seems to be the cygwin (gcc/gfortran) build. Windows seems to be too crowded for so many MPI versions to succeed. -- Tim Prince

Re: [OMPI users] intel compiler and openmpi 1.8.1

On 05/29/2014 07:11 AM, Lorenzo Donà wrote: I compiled openmpi 1.8.1 with intel compiler with this conf. ./configure FC=ifort CC=icc CXX=icpc --prefix=/Users/lorenzodona/Documents/openmpi-1.8.1/ but when i write mpif90 -v i found: Using built-in specs. COLLECT_GCC=/opt/local/bin/gfortran-mp

Re: [OMPI users] openmpi linking problem

mpifort to link, you would use -lstdc++ in place of -lmpi -lgfortran . -- Tim Prince

Re: [OMPI users] openMP and mpi problem

fort co-arrays will not cooperate with presence of OpenMPI. -- Tim Prince

Re: [OMPI users] Multiple threads for an mpi process

On 9/12/2014 6:14 AM, JR Cary wrote: This must be a very old topic. I would like to run mpi with one process per node, e.g., using -cpus-per-rank=1. Then I want to use openmp inside of that. But other times I will run with a rank on each physical core. Inside my code I would like to detect wh

Re: [OMPI users] Multiple threads for an mpi process

On 9/12/2014 9:22 AM, JR Cary wrote: On 9/12/14, 7:27 AM, Tim Prince wrote: On 9/12/2014 6:14 AM, JR Cary wrote: This must be a very old topic. I would like to run mpi with one process per node, e.g., using -cpus-per-rank=1. Then I want to use openmp inside of that. But other times I

Re: [OMPI users] Fortran and OpenMPI 1.8.3 compiled with Intel-15 does nothing silently

Check by ldd in case you didn't update .so path Sent via the ASUS PadFone X mini, an AT&T 4G LTE smartphone Original Message From:John Bray Sent:Mon, 17 Nov 2014 11:41:32 -0500 To:us...@open-mpi.org Subject:[OMPI users] Fortran and OpenMPI 1.8.3 compiled with Intel-15 does

Re: [OMPI users] Help on the big picture..

s extended grids too). snipped tons of stuff rather than attempt to reconcile top postings -- Tim Prince

Re: [OMPI users] OpenMPI Run-Time "Freedom" Question

e extent that a build made with 10.1 would work with 11.1 libraries. The most recent Intel library compatibility break was between MKL 9 and 10. -- Tim Prince

Re: [OMPI users] OpenMPI Run-Time "Freedom" Question

On 8/12/2010 6:04 PM, Michael E. Thomadakis wrote: On 08/12/10 18:59, Tim Prince wrote: On 8/12/2010 3:27 PM, Ralph Castain wrote: Ick - talk about confusing! I suppose there must be -some- rational reason why someone would want to do this, but I can't imagine what it would be I

Re: [OMPI users] send and receive buffer the same on root

diagnostic from Intel MPI run-time, due to multiple uses of the same buffer.Moral: even if it works for you now with openmpi, you could be setting up for unexpected failure in the future. -- Tim Prince

Re: [OMPI users] Memory affinity

seful introduction to affinity. It's available in a default build, but not enabled by default. If you mean something other than this, explanation is needed as part of your question. taskset() or numactl() might be relevant, if you require more detailed control. -- Tim Prince

Re: [OMPI users] Memory affinity

uot; Can i set processory affinity without memory affinity? This is my question.. 2010/9/27 Tim Prince On 9/27/2010 9:01 AM, Gabriele Fatigati wrote: if OpenMPI is numa-compiled, memory affinity is enabled by default? Because I didn't find memory affinity alone ( similar) parameter to se

Re: [OMPI users] Memory affinity

On 9/27/2010 2:50 PM, David Singleton wrote: On 09/28/2010 06:52 AM, Tim Prince wrote: On 9/27/2010 12:21 PM, Gabriele Fatigati wrote: HI Tim, I have read that link, but I haven't understood if enabling processor affinity are enabled also memory affinity because is written that: "

Re: [OMPI users] hdf5 build error using openmpi and Intel Fortran

s'; no argument required ld: libhdf5_fortran.so.6: No such file: No such file or directory Do -Wl,-rpath and -Wl,-soname= work any better? -- Tim Prince

Re: [OMPI users] link problem on 64bit platform

normal linux conventions a directory named /lib/ as opposed to /lib64/ would contain only 32-bit libraries. If gentoo doesn't conform with those conventions, maybe you should do your learning on a distro which does. -- Tim Prince

Re: [OMPI users] Help!!!!!!!!!!!!Openmpi instal for ubuntu 64 bits

er version you mentioned should resolve this automatically. -- Tim Prince

Re: [OMPI users] Help!!!!!!!!!!!!Openmpi instal for ubuntu 64 bits

ch an option, I used to do: sudo source .. compilervars.sh make install -- Tim Prince

Re: [OMPI users] Scalability issue

mpile line options for the application to change the default integer and real to 64-bit. I wasn't aware of any reluctance to use MPI_INTEGER8. -- Tim Prince

Re: [OMPI users] MPI_Send doesn't work if the data >= 2GB

PI_Recv() were a larger data type, you would see this limit. Did you look at your ? -- Tim Prince

Re: [OMPI users] meaning of MPI_THREAD_*

anyone try mixing auto-parallelization with MPI; that would require MPI_THREAD_MULTIPLE but still appears unpredictable. MPI_THREAD_FUNNELED is used often with OpenMP parallelization inside MPI. -- Tim Prince

Re: [OMPI users] Mac Ifort and gfortran together

ones. It's the same as on linux (and, likely, Windows). -- Tim Prince

Re: [OMPI users] Call to MPI_Test has large time-jitter

ur -mca affinity settings. Even if the defaults don't choose optimum mapping, it's way better than allowing them to float as you would with multiple independent jobs running. -- Tim Prince

Re: [OMPI users] Running OpenMPI on SGI Altix with 4096 cores : very poor performance

ar with marketing. I haven't seen an equivalent investigation for the 6-core CPUs, where various strange performance effects have been noted, so, as Jeff said, the hyperthreading effect could be "in the noise." -- Tim Prince

Re: [OMPI users] What's wrong with this code?

the same scope. If so, it seems good that the compiler catches it. -- Tim Prince

Re: [OMPI users] What's wrong with this code?

On 2/23/2011 6:41 AM, Prentice Bisbal wrote: Tim Prince wrote: On 2/22/2011 1:41 PM, Prentice Bisbal wrote: One of the researchers I support is writing some Fortran code that uses Open MPI. The code is being compiled with the Intel Fortran compiler. This one line of code: integer ierr

Re: [OMPI users] What's wrong with this code?

On 2/23/2011 8:27 AM, Prentice Bisbal wrote: Jeff Squyres wrote: On Feb 23, 2011, at 9:48 AM, Tim Prince wrote: I agree with your logic, but the problem is where the code containing the error is coming from - it's comping from a header files that's a part of Open MPI, which make

Re: [OMPI users] Open MPI access the same file in parallel ?

n compiler/library are reasonably up to date, you will need to specify action='read' as opening once with default readwrite will lock out other processes. -- Tim Prince

Re: [OMPI users] Open MPI access the same file in parallel ?

evaluate to 'r' (readonly). -- Tim Prince

Re: [OMPI users] intel compiler linking issue and issue of environment variable on remote node, with open mpi 1.4.3

as -xW. It's likely that no one has verified OpenMPI with a compiler of that vintage. We never used the 32-bit compiler for MPI, and we encountered run-time library bugs for the ifort x86_64 which weren't fixed until later versions. -- Tim Prince

Re: [OMPI users] Shared Memory Performance Problem.

ther this is due to excessive eviction of data from cache; not a simple question, as most recent CPUs have 3 levels of cache, and your application may require more or less data which was in use prior to the message receipt, and may use immediately only a small piece of a large message. -- Tim Prince

Re: [OMPI users] Shared Memory Performance Problem.

e the guess that the performance difference under discussion referred to a single node. -- Tim Prince

Re: [OMPI users] Shared Memory Performance Problem.

On 3/28/2011 3:29 AM, Michele Marena wrote: Each node have two processors (no dual-core). which seems to imply that the 2 processors share memory space and a single memory buss, and the question is not about what I originally guessed. -- Tim Prince

Re: [OMPI users] Shared Memory Performance Problem.

torage issue about cache eviction to arise. -- Tim Prince

Re: [OMPI users] OMPI monitor each process behavior

you consider ganglia et al? I cannot use ssh to access each node. How can MPI run? The program takes 8 hours to finish. -- Tim Prince

Re: [OMPI users] Problem compiling OpenMPI on Ubuntu 11.04

%29 where you should see that you must take care to set option -std=c++0x when using current under icpc, as it is treated as a c++0x feature. You might try adding the option to the CXXFLAGS or whatever they are called in openmpi build (or to the icpc.cfg in your icpc installation). -- Tim Prince

Re: [OMPI users] Mixing the FORTRAN and C APIs.

ce of MPI implementation. Some of us still may be cursing the choice of OpenMPI for the name of an MPI implementation. -- Tim Prince

Re: [OMPI users] Mixing the FORTRAN and C APIs.

On 5/6/2011 10:22 AM, Tim Hutt wrote: On 6 May 2011 16:45, Tim Hutt wrote: On 6 May 2011 16:27, Tim Prince wrote: If you want to use the MPI Fortran library, don't convert your Fortran to C. It's difficult to understand why you would consider f2c a "simplest way," bu

Re: [OMPI users] USE mpi

if you had 2 versions of the same named compiler? -- Tim Prince

Re: [OMPI users] MPI_COMM_DUP freeze with OpenMPI 1.4.1

MPI has affinity with Westmere awareness turned on by default. I suppose testing without affinity settings, particularly when banging against all hyperthreads, is a more severe test of your application. Don't you get better results at 1 rank per core? -- Tim Prince

Re: [OMPI users] OpenMPI vs Intel Efficiency question

form very close, if using equivalent settings, when working within the environments for which both are suited. -- Tim Prince

Re: [OMPI users] OpenMPI vs Intel Efficiency question

al application to find a gain for running 2 MPI processes per core, but if the sight of 4 processes running on your graph was your goal, I won't argue against it. You must be aware that most clusters running CPUs of the past have HT disabled in BIOS setup. -- Tim Prince

Re: [OMPI users] How could OpenMPI (or MVAPICH) affect floating-point results?

02b6e7e7f4000) libintlc.so.5 => /opt/intel/Compiler/11.1/072/lib/intel64/libintlc.so.5 (0x2b6e7ea0a000) -- Tim Prince

Re: [OMPI users] EXTERNAL: Re: How could OpenMPI (or MVAPICH) affect floating-point results?

irect instruction set translations which shouldn't vary from -O1 on up nor with linkage options nor be affected by MPI or insertion of WRITEs. -- Tim Prince

Re: [OMPI users] Building with thread support on Windows?

ral linuxes and mac and it works fine there. Not all Windows compilers work well enough with all threading models that you could expect satisfactory results; in particular, the compilers and thread libraries you use on linux may not be adequate for Windows thread support. -- Tim Prince

Re: [OMPI users] Question about compilng with fPIC

iles should be built with -fPIC or similar. Ideally, the configure and build tools would enforce this. -- Tim Prince

Re: [OMPI users] EXTERNAL: Re: Question about compilng with fPIC

I or application build, and you must have linked in static versions of your MPI libraries, where -fPIC wouldn't be required. -- Tim Prince

Re: [OMPI users] How to justify the use MPI codes on multicore systems/PCs?

rank pinned to a single L3 cache. All 3 MPI implementations which were tested have full shared memory message passing and pinning to local cache within each node (OpenMPI and 2 commercial MPIs). -- Tim Prince

Re: [OMPI users] openmpi - gfortran and ifort conflict

e your PATH and LD_LIBRARY_PATH correctly simply by specifying absolute path to mpif90. -- Tim Prince

Re: [OMPI users] openmpi - gfortran and ifort conflict

ntel cluster checker, you will see noncompliance if anyone's MPI is on the default paths. You must set paths explicitly according to the MPI you want. Admittedly, that tool didn't gain a high level of adoption. -- Tim Prince

Re: [OMPI users] openmpi - gfortran and ifort conflict

rying to install with ifort. This is one of the reasons for recommending complete removal (rpm -e if need be) of any MPI which is on a default path (and setting a clean path) before building a new one, as well as choosing a unique install path for the new one. -- Tim Prince

Re: [OMPI users] parallelising ADI

to be implemented in parallelizable fashion (not SSOR style where each line uses updates from the previous line), it should be feasible to divide the outer loop into an appropriate number of blocks, or decompose the physical domain and perform ADI on individual blocks, then update and repeat. -

Re: [OMPI users] [EXTERNAL] Possible to build ompi-1.4.3 or 1.4.5 without a C++ compiler?

libraries would be linked automatically. There was a single release of the compiler several years ago (well out of support now) where that sse2 library was omitted, although the sse3 version was present. -- Tim Prince

Re: [OMPI users] redirecting output

> FILENAME and > log & these generate files however they are empty.any help would be appreciated. If you run under screen your terminal output should be collected in screenlog. Beats me why some sysadmins don't see fit to install screen. -- Tim Prince

Re: [OMPI users] Cannot compile code with gfortran + OpenMPI when OpenMPI was built with latest intl compilers

compilers, so as to configure it to keep it off the default PATHs (e.g. --prefix=/opt/ompi1.4gf/), if you can't move the Ubuntu ompi. Surely most of this is implied in the OpenMPI instructions. -- Tim Prince

Re: [OMPI users] undefined reference to `netcdf_mp_nf90_open_'

ler you are using, it appears that either you didn't build the netcdf Fortran 90 modules with that compiler, or you didn't set the include path for the netcdf modules. This would work the same with mpif90 as with the underlying Fortran compiler. -- Tim Prince

Re: [OMPI users] compilation on windows 7 64-bit

rning) cmsolver.cpp Which indicates that the openmpi version "openmpi_v1.6-x64" is 64 bit. And I'm sure that I installed the 64 bit version. I am compiling on a 64 bit version of Windows 7. setting X64 compiler project options? -- Tim Prince

Re: [OMPI users] mpi.h incorrect format error?

int where the compiler (gcc?) complains. I suppose you must have built mpicc yourself; you would need to assure that the mpicc on PATH is the one built with the C compiler on PATH. -- Tim Prince

Re: [OMPI users] 转发：lwkmpi

ask }; } ^ Looks like your icpc is too old to work with your g++. If you want to build with C++ support, you'll need better matching versions of icpc and g++. icpc support for g++4.7 is expected to release within the next month; icpc 12.1 should be fine with g++ 4.5 and 4.6. -- Tim Prince

Re: [OMPI users] Compiling 1.6.1 with cygwin 1.7 and gcc

h". Do you have a reason for withholding information such as which Windows version you want to support, and your configure commands? -- Tim Prince

Re: [OMPI users] mpivars.sh - Intel Fortran 13.1 conflict with OpenMPI 1.6.3

d you would want to find a way to avoid any reference to that library, possibly by avoiding sourcing that part of ifort's compilervars. If you want a response on this subject from the Intel support team, their HPC forum might be a place to bring it up: http://software.intel.com/en-us/forums/intel-clusters-and-hpc-technology -- Tim Prince

Re: [OMPI users] memory per core/process

than the rule. -- Tim Prince

Re: [OMPI users] Configuration with Intel C++ Composer 12.0.2 on OSX 10.7.5

en't duplicated by the newer ones. You also need the 64-bit g++ active. -- Tim Prince

Re: [OMPI users] Configuration with Intel C++ Composer 12.0.2 on OSX 10.7.5

On 05/16/2013 10:13 PM, Tim Prince wrote: On 5/16/2013 2:16 PM, Geraldine Hochman-Klarenberg wrote: Maybe I should add that my Intel C++ and Fortran compilers are different versions. C++ is 12.0.2 and Fortran is 13.0.2. Could that be an issue? Also, when I check for the location of ifort, it

Re: [OMPI users] basic questions about compiling OpenMPI

ld yourself, even if you use a (preferably more up to date version of) gcc, which you can use along with one of the commercial Fortran compilers for linux. -- Tim Prince

Re: [OMPI users] EXTERNAL: Re: basic questions about compiling OpenMPI

d the compiler used to build the application. So there really isn't a good incentive to retrogress away from the USE files simply to avoid one aspect of mixing incompatible compilers. -- Tim Prince

Re: [OMPI users] [EXTERNAL] MPI_THREAD_SINGLE vs. MPI_THREAD_FUNNELED

On 10/23/2013 01:02 PM, Barrett, Brian W wrote: On 10/22/13 10:23 AM, "Jai Dayal" > wrote: I, for the life of me, can't understand the difference between these two init_thread modes. MPI_THREAD_SINGLE states that "only one thread will execute", but MP

Re: [OMPI users] compilation aborted for Handler.cpp (code 2)

g++ as well as icpc run-times on LD_LIBRARY_PATH everywhere. You can't mix support for gfortran with support for ifort; for C and C++ you should be able to use gcc/g++ and icc/icpc interchangeably, so you could configure for gcc and g++ along with ifort and still use icc and icpc as you choose. -- Tim Prince

Re: [OMPI users] Running on two nodes slower than running on one node

ine. -- Reuti ___ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users ___ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users -- Tim Prince

Re: [OMPI users] Running on two nodes slower than running on one node

. It really doesn't look like a beginner's project. -- Tim Prince

Re: [OMPI users] Running on two nodes slower than running on one node

a process across sockets is an important one. Even splitting a process across internal busses, which would happen with 3 threads per process, seems problematical. -- Tim Prince

Re: [OMPI users] Use of __float128 with openmpi

On 02/01/2014 12:42 PM, Patrick Boehl wrote: Hi all, I have a question on datatypes in openmpi: Is there an (easy?) way to use __float128 variables with openmpi? Specifically, functions like MPI_Allreduce seem to give weird results with __float128. Essentially all I found was http://beige

Re: [OMPI users] Use of __float128 with openmpi

On 02/01/2014 12:42 PM, Patrick Boehl wrote: Hi all, I have a question on datatypes in openmpi: Is there an (easy?) way to use __float128 variables with openmpi? Specifically, functions like MPI_Allreduce seem to give weird results with __float128. Essentially all I found was http://beige

Re: [OMPI users] linking with openmpi version 1.6.1

te documentation remaining on line). Also, FWIW, OMPI 1.6.1 is ancient. Can you upgrade to the latest 1.6.x version of Open MPI: 1.6.5? -- Tim Prince

Re: [OMPI users] MPI Processes and Auto Vectorization

amjad ali wrote: Hi, Suppose we run a parallel MPI code with 64 processes on a cluster, say of 16 nodes. The cluster nodes has multicore CPU say 4 cores on each node. Now all the 64 cores on the cluster running a process. Program is SPMD, means all processes has the same workload. Now if we

Re: [OMPI users] MPI Processes and Auto Vectorization

amjad ali wrote: Hi, thanks T.Prince, Your saying: "I'll just mention that we are well into the era of 3 levels of programming parallelization: vectorization, threaded parallel (e.g. OpenMP), and process parallel (e.g. MPI)." is a really great new learning for me. Now I can perceive better.

Re: [OMPI users] Mimicking timeout for MPI_Wait

Jeff Squyres wrote: On Dec 3, 2009, at 3:31 AM, Katz, Jacob wrote: I wonder if there is a BKM (efficient and portable) to mimic a timeout with a call to MPI_Wait, i.e. to interrupt it once a given time period has passed if it hasn’t returned by then yet. Pardon my ignorance, but what does B

Re: [OMPI users] mpirun only works when -np <4

Gus Correa wrote: Hi Matthew 5) Are you setting processor affinity on mpiexec? mpiexec -mca mpi_paffinity_alone 1 -np ... bla, bla ... Good point. This option optimizes processor affinity on the assumption that no other jobs are running. If you ran 2 MPI jobs with this option, they wou

Re: [OMPI users] OpenMPI/NAG Fortran: Missing libf52.so.1

be done in your user settings so it doesn't affect anyone else. -- Tim Prince

Re: [OMPI users] OpenMPI multithreaded performance

computation and so on Maybe I don't understand your question. Are you saying that none of the references found by search terms such as "hybrid mpi openmp" are useful for you? They cover so many topics, you would have to be much more specific about which topics you want in more d

Re: [OMPI users] open-mpi behaviour on Fedora, Ubuntu, Debian and CentOS

r SSE control registers, 32- vs. 64-bit compilation. SSE2 is the default for 64-bit compilation, but compilers vary on defaults for 32-bit. If your program depends on x87 extra precision of doubles, or efficient mixing of double and long double, 387 code may be a better choice, but limits your efficiency. -- Tim Prince

Re: [OMPI users] open-mpi behaviour on Fedora, Ubuntu, Debian and CentOS

nitialized variables or range errors. If you are lucky, turning on the associated gcc diagnostics and run-time checks may help discover them. -- Tim Prince

Re: [OMPI users] Fortran support on Windows Open-MPI

ers a pre-built version compatible with Intel Fortran. Intel also offers MPI, derived originally from Argonne MPICH2, for both Windows and linux. I can't imagine OpenMPI libraries being added to the Microsoft HPC environment; maybe that's not exactly what the top poster meant. -- Tim Prince

Re: [OMPI users] How do I run OpenMPI safely on a Nehalem standalone machine?

process or thread per core. With careful affinity, performance when using 1 logical per core normally is practically the same as with HT disabled. -- Tim Prince

Re: [OMPI users] How do I run OpenMPI safely on a Nehalem standalone machine?

m in RHEL5/CentOS-5 it's easy to switch it on and off on the fly. ___ That's the same as Jeff explained. It requires root privilege, and affects all users. -- Tim Prince

Re: [OMPI users] is loop unrolling safe for MPI logic?

down. I'm not counting on that magically making the bug go away. ifort is not particularly aggressive about unrolling loops which contain MPI calls, but I agree that must be considered. -- Tim Prince

Re: [OMPI users] mpirun

I don't recall Walt 's cases taking all of 5 seconds to start. More annoying is the hang after completion. Sent via the ASUS PadFone X mini, an AT&T 4G LTE smartphone Original Message From:Ralph Castain Sent:Fri, 29 May 2015 15:35:15 -0400 To:Open MPI Users Subject:Re: [OMPI

Re: [OMPI users] Anyone successfully running Abaqus with OpenMPI?

about type encoding compatibility. Lack of instructions for openmpi probably means something. -- Tim Prince

Re: [OMPI users] Binding to hardware thread

not start with the FAQ? https://www.open-mpi.org/faq/?category=openfabrics Don't go by what the advertisements of other MPI implementations said based on past defaults. -- Tim Prince

Re: [OMPI users] How to run OpenMPI C code under Windows 7

omp.lang.fortran/coarray$20fortran/comp.lang.fortran/P5si9Fj1yIY/ptjM8DMUUzUJ It's a little difficult to use if you have another MPI installed, as Windows MPI (like the MPI which comes with linux distros) don't observe normal methods for keeping distinct paths. I doubt there is a separate version of OpenMPI docs specific to Windows. -- Tim Prince

Re: [OMPI users] Problems in compiling a code with dynamic linking

LIB line could be > > LIB = -static -L/opt/intel/composer_xe_2013_sp1/mkl/lib/intel64 > -lmkl_blas95_lp64 -lmkl_lapack95_lp64 -lmkl_intel_lp64 -lmkl_core > -lmkl_sequential -dynamic > No, refer to the on-line advisor at https://software.intel.com/en-us/articles/intel-mkl-link-line-advisor -- Tim Prince

Re: [OMPI users] openmpi-2.0.1

Error 1 > Do you have the Intel compilervars.[c]sh sourced (and associated library files visible) on each node where you expect to install? -- Tim Prince ___ users mailing list users@lists.open-mpi.org https://rfd.newmexicoconsortium.org/mailman/listinfo/users

Re: [OMPI users] Rounding errors and MPI

You might try inserting parentheses so as to specify your preferred order of evaluation. If using ifort, you would need -assume protect-parens . Sent via the ASUS PadFone X mini, an AT&T 4G LTE smartphone Original Message From:Oscar Mojica Sent:Mon, 16 Jan 2017 08:28:05 -0500

Re: [OMPI users] Performance degradation of OpenMPI 1.10.2 when oversubscribed?

scheduling (although linux is more capable than Windows). Agree that explicit use of taskset under MPI should have been superseded by the options implemented by several MPI including openmpi. -- Tim Prince ___ users mailing list users@list