Re: [OMPI users] Building 32-bit OpenMPI package for 64-bit Opteron platform

[Ralph Castain]

Heterogeneous operations are not supported on 1.0 - they are, however, on the new 1.1. :-) Also, remember that you must configure for static operation for bproc - use the configuration options "--enable-static --disable-shared". Our current bproc launcher *really* dislikes shared libraries.... ;-) Ralph David Daniel wrote: I suspect that to get this to work for bproc, then we will have to build mpirun as 64-bit and the library as 32-bit. That's because a 32-bit compiled mpirun calls functions in the 32-bit /usr/lib/ libbroc.so which don't appear to function when the system is booted 64-bit. Of course that would mean we need heterogeneous support to run on a single homogeneous system! Will this work on the 1.0 branch? An alternative worth thinking about is to bypass the library calls and start processes using a system() call to invoke the bpsh command. This is a 64-bit executable linked with /usr/lib64/ libbproc.so and which successfully launches both 32- and 64-bit executables. I'm currently trying to solve the same issue for LA-MPI :( David On Apr 10, 2006, at 9:18 AM, Brian Barrett wrote: On Apr 10, 2006, at 11:07 AM, David Gunter wrote: (flashc 105%) mpiexec -n 4 ./send4 [flashc.lanl.gov:09921] mca: base: component_find: unable to open: / lib/libc.so.6: version `GLIBC_2.3.4' not found (required by /net/ scratch1/dog/flash64/openmpi/openmpi-1.0.2-32b/lib/openmpi/ mca_paffinity_linux.so) (ignored) [flashc.lanl.gov:09921] mca: base: component_find: unable to open: libbproc.so.4: cannot open shared object file: No such file or directory (ignored) [flashc.lanl.gov:09921] mca: base: component_find: unable to open: libbproc.so.4: cannot open shared object file: No such file or directory (ignored) [flashc.lanl.gov:09921] mca: base: component_find: unable to open: libbproc.so.4: cannot open shared object file: No such file or directory (ignored) [flashc.lanl.gov:09921] mca: base: component_find: unable to open: libbproc.so.4: cannot open shared object file: No such file or directory (ignored) [flashc.lanl.gov:09921] mca: base: component_find: unable to open: libbproc.so.4: cannot open shared object file: No such file or directory (ignored) mpiexec: relocation error: /net/scratch1/dog/flash64/openmpi/ openmpi-1.0.2-32b/lib/openmpi/mca_soh_bproc.so: undefined symbol: bproc_nodelist The problem now looks like /lib/libc.so.6 is not longer available. Indeed, it is available on the compiler nodes but it cannot be found on the backend nodes - whoops! Well, that's interesting. Is this on a bproc platform? If so, you might be best off configuring with either --enable-static or -- disable-dlopen. Either one will prevent components from loading, which doesn't seem to always work well. Also, it looks like at least one of the components has a different libc its linked against than the others. This makes me think that perhaps you have some old components from a previous build in your tree. You might want to completely remove your installation prefix (or lib/openmpi in your installation prefix) and run make install again. Are you no longer seeing the errors about epoll? The other problem is that the -m32 flag didn't make it into mpicc for some reason. This is expected behavior. There are going to be more and more cases where Open MPI provides one wrapper compiler that does the right thing whether the user passes in -m32 / -m64 (or any of the vendor options for doing the same thing). So it will be increasingly impossible for us to know what to add (but as Jeff said, you can tell configure to always add -m32 to the wrapper compilers if you want). Brian _______________________________________________ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users _______________________________________________ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users