George Bosilca wrote:
> Btw, can you run the Netpipe benchmark on this configuration please ?
> Once compiled with MPI support and once with TCP. This might give us
> more equitable details (same benchmark).
NPmpi and NPtcp belong to Netpipe but this doesn't mean that they do the same ;-). Anywa
Unfortunately, I can hardly imagine where the performance problems are
coming from. Usually I get more than 97% out of the raw TCP
performance with Open MPI. There are two parameters hat can slightly
improve the behavior: btl_tcp_rdma_pipeline_send_length and
btl_tcp_min_rdma_pipeline_size.
Andy Georgi wrote:
Steve Wise wrote:
Are you using Chelsio's TOE drivers? Or just a driver from the distro?
We use the Chelsio TOE drivers.
Steve Wise wrote:
Ok. Did you run their perftune.sh script?
Yes, if not we wouldn't get the 1.15 GB/s on the TCP level. We had
~800 MB/s before
p
Jon Mason wrote:
On Mon, Aug 18, 2008 at 10:00:24AM +0200, Andy Georgi wrote:
Steve Wise wrote:
Are you using Chelsio's TOE drivers? Or just a driver from the distro?
We use the Chelsio TOE drivers.
Steve Wise wrote:
Ok. Did you run their perftune.sh script?
T
On Mon, Aug 18, 2008 at 10:00:24AM +0200, Andy Georgi wrote:
> Steve Wise wrote:
>> Are you using Chelsio's TOE drivers? Or just a driver from the distro?
>
> We use the Chelsio TOE drivers.
>
>
> Steve Wise wrote:
>> Ok. Did you run their perftune.sh script?
That script should optimally tune yo
Steve Wise wrote:
Are you using Chelsio's TOE drivers? Or just a driver from the distro?
We use the Chelsio TOE drivers.
Steve Wise wrote:
Ok. Did you run their perftune.sh script?
Yes, if not we wouldn't get the 1.15 GB/s on the TCP level. We had ~800 MB/s
before
primarily because of t
Andy Georgi wrote:
Hello again ;),
after getting acceptable latency on our Chelsio S320E-CXA adapters we
now want to check if we can
also tune the bandwidth. On TCP level (measured via iperf) we get 1.15
GB/s, on MPI level (measured
via MPI-Ping-Pong) just 930 MB/s. We already set btl_tcp_sndb
Hello again ;),
after getting acceptable latency on our Chelsio S320E-CXA adapters we now want
to check if we can
also tune the bandwidth. On TCP level (measured via iperf) we get 1.15 GB/s, on
MPI level (measured
via MPI-Ping-Pong) just 930 MB/s. We already set btl_tcp_sndbuf and
btl_tcp_rcvb
