Re: [OMPI users] --mca btl_openib_if_include

2008-10-18 Thread Jeff Squyres
On Oct 16, 2008, at 9:10 PM, Mostyn Lewis wrote: OpenMPI says for a: mpirun --prefix /tools/openmpi/1.4a1r19757_svn/connectx/gcc64/4.1.2/ openib/rh_EL_4/x86_64/xeon -x LD_LIBRARY_PATH --mca btl_openib_verbose 1 --mca btl openib,self --mca btl_openib_if_include "mlx4_0:1,mlx4_1:1" -np 4 -mac

Re: [OMPI users] OPAL_PREFIX is not passed to remote node in pls_rsh_module.c

2008-10-18 Thread Jeff Squyres
On Oct 17, 2008, at 6:00 AM, Teng Lin wrote: It seems to work after I patched pls_rsh_module.c --- pls_rsh_module.c.orig 2008-10-16 17:15:32.0 -0400 +++ pls_rsh_module.c2008-10-16 17:15:51.0 -0400 @@ -989,7 +989,7 @@ "%s/%s/%s",

Re: [OMPI users] OpenMPI portability problems: debug info isn't helpful

2008-10-18 Thread Jeff Squyres
On Oct 16, 2008, at 1:39 PM, Aleksej Saushev wrote: [asau.local:04648] opal_ifinit: ioctl(SIOCGIFFLAGS) failed with errno=6 [snip] Why don't you use strerror(3) to print errno value explanation? I don't know; whoever wrote that just chose not to there. Shrug. From : #define ENXIO

Re: [OMPI users] MPI_ERR_TRUNCATE

2008-10-18 Thread Jeff Squyres
On Oct 17, 2008, at 6:03 PM, Nick Collier wrote: And under some conditions, I get the error: [3] [belafonte.home:04938] *** An error occurred in MPI_Wait [3] [belafonte.home:04938] *** on communicator MPI_COMM_WORLD [3] [belafonte.home:04938] *** MPI_ERR_TRUNCATE: message truncated [3] [belafon

Re: [OMPI users] --mca btl_openib_if_include

2008-10-18 Thread Mostyn Lewis
Jeff, I traced this and it was the quote marks in "mlx4_0:1,mlx4_1:1" - they were passed in and caused the mismatch :-( Sorry about that. Regards, DM On Sat, 18 Oct 2008, Jeff Squyres wrote: On Oct 16, 2008, at 9:10 PM, Mostyn Lewis wrote: OpenMPI says for a: mpirun --prefix /tools/openmp

[OMPI users] Can 2 IB HCAs give twice the bandwidth?

2008-10-18 Thread Mostyn Lewis
Can OpenMPI do like Scali and MVAPICH2 and utilize 2 IB HCAs per machine to approach double the bandwidth on simple tests such as IMB PingPong? Regards, DM