Re: [OMPI users] TCP Latency

2008-08-17 Thread Steve Wise
With OpenMPI 1.3 / iWARP you should get around 8us latency using mpi pingpong tests. Andy Georgi wrote: Thanks again for all the answers. It seems that were was a bug in the driver in combination with Suse Linux Enterprise Server 10. It was fixed with version 1.0.146. Now we have 12us with NP

Re: [OMPI users] TCP Latency

2008-07-30 Thread Andy Georgi
Thanks again for all the answers. It seems that were was a bug in the driver in combination with Suse Linux Enterprise Server 10. It was fixed with version 1.0.146. Now we have 12us with NPtcp and 22us with NPmpi. This is still not fast enough but for the time acceptable. I will check the alter

Re: [OMPI users] TCP Latency

2008-07-29 Thread Kozin, I (Igor)
> Thanks for the fast answer. So is this latency normal for TCP > communications over MPI!? Could RDMA maybe reduce the latency? It > should work with those cards but there are still problems with OFED. > iWARP is also one of the features they offer but if it works... Hi Andy, Yes, ~40us TCP laten

Re: [OMPI users] TCP Latency

2008-07-29 Thread Jeff Squyres
On Jul 29, 2008, at 6:01 AM, George Bosilca wrote: I just want to make sure that I correctly understand your statement. You're saying that running NetPIPE (NPtcp) directly over TCP give you a latency of 12us, but running NetPIPE (NPmpi) over Open MPI bring this latency up to 45us ? That d

Re: [OMPI users] TCP Latency

2008-07-29 Thread Jeff Squyres
On Jul 29, 2008, at 4:52 AM, Andy Georgi wrote: The upcoming Open MPI v1.3 series will support iWARP, which gives much better latency than that. I don't know all the Chelsio models offhand; are those iWARP-capable cards? Thanks for the fast answer. So is this latency normal for TCP commun

Re: [OMPI users] TCP Latency

2008-07-29 Thread George Bosilca
I just want to make sure that I correctly understand your statement. You're saying that running NetPIPE (NPtcp) directly over TCP give you a latency of 12us, but running NetPIPE (NPmpi) over Open MPI bring this latency up to 45us ? george. On Jul 29, 2008, at 10:52 AM, Andy Georgi wrote:

Re: [OMPI users] TCP Latency

2008-07-29 Thread Andy Georgi
Zitat von Jeff Squyres : On Jul 28, 2008, at 2:53 PM, Andy Georgi wrote: we use Chelsio S320E-CXA adapters (http://www.chelsio.com/assetlibrary/products/S320E%20Product%20Brief%20080424.pdf) in one of our clusters. After tuning the kernel i measured the ping pong latency via NetPIPE and got

Re: [OMPI users] TCP Latency

2008-07-28 Thread Jeff Squyres
On Jul 28, 2008, at 2:53 PM, Andy Georgi wrote: we use Chelsio S320E-CXA adapters (http://www.chelsio.com/assetlibrary/products/S320E%20Product%20Brief%20080424.pdf ) in one of our clusters. After tuning the kernel i measured the ping pong latency via NetPIPE and got ~12us which is pretty good

[OMPI users] TCP Latency

2008-07-28 Thread Andy Georgi
Hi all, we use Chelsio S320E-CXA adapters (http://www.chelsio.com/assetlibrary/products/S320E%20Product%20Brief%20080424.pdf) in one of our clusters. After tuning the kernel i measured the ping pong latency via NetPIPE and got ~12us which is pretty good for TCP i think. So i wrote a simple pin