With OpenMPI 1.3 / iWARP you should get around 8us latency using mpi
pingpong tests.
Andy Georgi wrote:
Thanks again for all the answers. It seems that were was a bug in the
driver in combination with
Suse Linux Enterprise Server 10. It was fixed with version 1.0.146.
Now we have 12us with NP
Thanks again for all the answers. It seems that were was a bug in the driver in
combination with
Suse Linux Enterprise Server 10. It was fixed with version 1.0.146. Now we have
12us with NPtcp and
22us with NPmpi. This is still not fast enough but for the time acceptable. I
will check the
alter
> Thanks for the fast answer. So is this latency normal for TCP
> communications over MPI!? Could RDMA maybe reduce the latency? It
> should work with those cards but there are still problems with OFED.
> iWARP is also one of the features they offer but if it works...
Hi Andy,
Yes, ~40us TCP laten
On Jul 29, 2008, at 6:01 AM, George Bosilca wrote:
I just want to make sure that I correctly understand your statement.
You're saying that running NetPIPE (NPtcp) directly over TCP give
you a latency of 12us, but running NetPIPE (NPmpi) over Open MPI
bring this latency up to 45us ?
That d
On Jul 29, 2008, at 4:52 AM, Andy Georgi wrote:
The upcoming Open MPI v1.3 series will support iWARP, which gives
much
better latency than that. I don't know all the Chelsio models
offhand;
are those iWARP-capable cards?
Thanks for the fast answer. So is this latency normal for TCP
commun
I just want to make sure that I correctly understand your statement.
You're saying that running NetPIPE (NPtcp) directly over TCP give you
a latency of 12us, but running NetPIPE (NPmpi) over Open MPI bring
this latency up to 45us ?
george.
On Jul 29, 2008, at 10:52 AM, Andy Georgi wrote:
Zitat von Jeff Squyres :
On Jul 28, 2008, at 2:53 PM, Andy Georgi wrote:
we use Chelsio S320E-CXA adapters
(http://www.chelsio.com/assetlibrary/products/S320E%20Product%20Brief%20080424.pdf)
in one of our clusters. After tuning the kernel i measured the ping
pong latency via NetPIPE and got
On Jul 28, 2008, at 2:53 PM, Andy Georgi wrote:
we use Chelsio S320E-CXA adapters (http://www.chelsio.com/assetlibrary/products/S320E%20Product%20Brief%20080424.pdf
) in one of our clusters. After tuning the kernel i measured the
ping pong latency via NetPIPE and got ~12us which is pretty good
Hi all,
we use Chelsio S320E-CXA adapters
(http://www.chelsio.com/assetlibrary/products/S320E%20Product%20Brief%20080424.pdf) in one of our
clusters. After tuning the kernel i measured the ping pong latency via NetPIPE and got ~12us which
is pretty good for TCP i think. So i wrote a simple pin