> I have some trouble with infiniband - and admittedly I am an infiniband > novice. I get 7GBit/s using TCP (iperf/wget and others). Oddly though > because it's a QDR (40GBit/s) switch. > Same results with 2.6.36, 2.6.38-rc2 kernel. > QLogic PCI-e cards and QLogic switches. > > I changed kernels/bios/tcp settings and what have you, but no luck. I > notice the cpu can be quite busy during these tests. > > Anyone seen something like this before or knows more about inifiniband > than me ? ;))
Yes we ran into a similar issue. We had put the IB card in the first available PCIU slot on the machines. On most machines some PCI slot are faster than others, these IB needed to be on a faster slot to be able to attain maximum speeds, of course this wasn't documented. Look for "connector width", on newer machines you typically have slots with "x8" and one or two with "x16" width. Move the cards to the faster/widest slots. -- Yves. http://www.SollerS.ca/ http://blog.zioup.org/ _______________________________________________ Tech mailing list [email protected] https://lists.lopsa.org/cgi-bin/mailman/listinfo/tech This list provided by the League of Professional System Administrators http://lopsa.org/
