On Sep 20, 2013, at 12:27 PM, Lloyd Brown <lloyd_br...@byu.edu> wrote:
> Interesting. I was taking the approach of "only exclude what you're > certain you don't want" (the native IB and TCP/IPoIB stuff) since I > wasn't confident enough in my knowledge of the OpenMPI internals, to > know what I should explicitly include. > > However, taking Jeff's suggestion, this does seem to work, and gives me > the expected Ethernet performance: > > "mpirun --mca btl tcp,sm,self --mca btl_tcp_if_include em1 ./osu_bw" > > So, in short, I'm still not sure why my exclude syntax doesn't work. Check two things: 1. What BTLs are available? Is there some other BTL that may be used instead of openib? 2. (this one is more likely) What IP interfaces are available on all nodes? The most obvious guess here is that you didn't exclude 127.0.0.1/8, and OMPI found this interface on all nodes, and therefore assumed that it was routable/usable on all nodes. Hence, one quick experiment might be to try your exclude syntax again, but *also* exclude 127.0.0.8/8. -- Jeff Squyres jsquy...@cisco.com For corporate legal information go to: http://www.cisco.com/web/about/doing_business/legal/cri/
