Hi, Yes, we 2 NICs on the same bus and the other 2 are embeded. We did the experiment about netperf in our cluster and we could not get full bandwith using 4 pairs copies on two nodes. the bandwidth is increased when the number of NICs changes to 2 but there is no big increase when it becomes 3, 4.
Thank you! Axida. ________________________________ From: Jeff Squyres <jsquy...@cisco.com> To: Open MPI Users <us...@open-mpi.org> Sent: Friday, June 5, 2009 11:19:02 PM Subject: Re: [OMPI users] How to use Multiple linkswithOpenMPI?????????????????? On Jun 4, 2009, at 3:42 AM, shan axida wrote: > We have Dell powerconnect 2724 Gigabit switches to connect the nodes in our > cluster. > As you said, may be the speed of PCI bus is a bottleneck. > How can check it in practical? Are all your gige nics on the same bus? You might want to try running multiple copies of TCP pt2pt benchmarks simultaneously on your machine to see what kind of performance you get. E.g., run 4 copies of netperf on node A talking to 4 corresponding copies of netper on node B. Do you get full bandwidth out of all 4 copies? --Jeff Squyres Cisco Systems _______________________________________________ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users
