Re: [OMPI users] btl_openib_ipaddr_include broken in 1.4.4rc2?

2011-09-04 Thread Yevgeny Kliteynik
On 30-Aug-11 4:50 PM, Michael Shuey wrote: > I'm using RoCE (or rather, attempting to) and need to select a > non-default GID to get my traffic properly classified. You probably saw it, but just making sure: http://www.open-mpi.org/faq/?category=openfabrics#ompi-over-roce > Both 1.4.4rc2 > and 1.

Re: [OMPI users] Mellanox/Voltaire FCA support

2011-09-04 Thread Andrew Senin
Hi Jeff, You should compile OpenMPI with the "--with-fca=" option. Then you can configure it the the following mca runtime options: coll_fca_enable - whether or not fca is enabled coll_fca_np - from which np to use fca coll_fca_enable_barrier coll_fca_enable_bcast ... See more options with ompi_i

[OMPI users] Bug in openmpi 1.5.4 in paffinity

2011-09-04 Thread Ake Sandgren
Hi! I'm getting a segfault in hwloc_setup_distances_from_os_matrix in the call to hwloc_bitmap_or due to objs or objs[i]->cpuset being freed and containing garbage, objs[i]->cpuset has infinite < 0. I only get this when using slurm with cgroups, asking for 2 nodes with 1 cpu each. The cpuset is t

Re: [OMPI users] Bug in openmpi 1.5.4 in paffinity

2011-09-04 Thread Brice Goglin
Hello, Could you log again on this node (with same cgroups enabled), run hwloc-gather-topology and send the resulting .output and .tar.bz2? Send them to the hwloc-devel or open a ticket on https://svn.open-mpi.org/trac/hwloc (or send them to me in private if you don't want to subscribe). th

Re: [OMPI users] Bug in openmpi 1.5.4 in paffinity

2011-09-04 Thread Brice Goglin
Le 04/09/2011 22:35, Ake Sandgren a écrit : > On Sun, 2011-09-04 at 22:13 +0200, Brice Goglin wrote: >> Hello, >> >> Could you log again on this node (with same cgroups enabled), run >> hwloc-gather-topology >> and send the resulting .output and .tar.bz2? >> >> Send them to the hwloc-devel or