On 2022-04-06 01:06, Drew Parsons wrote:
dalcini from mpi4py and ggouaillardet from openmpi both raised the
same question in their respective upstream issues: why is our MCA io
running through romio321 instead of the default "native" ompio?
Sounds like it might be the key to multiple problems.
Likely related to that question, ompio seems to have gone missing (which
could explain why romio321 is getting used)
$ dlocate ompio
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/fortran/gfortran-mod-15/openmpi/openmpi/ompi/mca/common/ompio
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/fortran/gfortran-mod-15/openmpi/openmpi/ompi/mca/common/ompio/common_ompio.h
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/fortran/gfortran-mod-15/openmpi/openmpi/ompi/mca/common/ompio/common_ompio_aggregators.h
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/fortran/gfortran-mod-15/openmpi/openmpi/ompi/mca/common/ompio/common_ompio_buffer.h
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/fortran/gfortran-mod-15/openmpi/openmpi/ompi/mca/common/ompio/common_ompio_print_queue.h
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/fortran/gfortran-mod-15/openmpi/openmpi/ompi/mca/common/ompio/common_ompio_request.h
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/ompi/mca/common/ompio
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/ompi/mca/common/ompio/common_ompio.h
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/ompi/mca/common/ompio/common_ompio_aggregators.h
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/ompi/mca/common/ompio/common_ompio_buffer.h
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/ompi/mca/common/ompio/common_ompio_print_queue.h
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/ompi/mca/common/ompio/common_ompio_request.h
libopenmpi-dev:amd64:
/usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_ompio.so
libopenmpi3:amd64:
/usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_io_ompio.so
$ dpkg -l libopenmpi-dev libopenmpi3
Desired=Unknown/Install/Remove/Purge/Hold
|
Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
+++-====================-============-============-==========================================================
ii libopenmpi-dev:amd64 4.1.3-1 amd64 high performance
message passing library -- header files
ii libopenmpi3:amd64 4.1.3-1 amd64 high performance
message passing library -- shared library
$ ls -l /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_ompio.so
lrwxrwxrwx 1 root root 30 Apr 2 10:05
/usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_ompio.so ->
libmca_common_ompio.so.41.29.3
$ ls -l /usr/lib/x86_64-linux-gnu/openmpi/lib/*ompio*
lrwxrwxrwx 1 root root 30 Apr 2 10:05
/usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_ompio.so ->
libmca_common_ompio.so.41.29.3
