Re: [OMPI users] Message compression in OpenMPI

2008-04-28 Thread Tomas Ukkonen
Aurélien Bouteiller wrote: > From a pretty old experiment I made, compression was giving good > results on 10Mbps network but was actually decreasing RTT on 100Mbs > and more. I played with all the zlib settings from 1 to 9, and > actually even the low compression setting was unable to reach

Re: [OMPI users] Message compression in OpenMPI

2008-04-24 Thread Aurélien Bouteiller
From a pretty old experiment I made, compression was giving good results on 10Mbps network but was actually decreasing RTT on 100Mbs and more. I played with all the zlib settings from 1 to 9, and actually even the low compression setting was unable to reach decent performance. I don't belie

Re: [OMPI users] Message compression in OpenMPI

2008-04-24 Thread George Bosilca
Actually, even in this particular condition (over internet)1 compression make sense only for very specific data. The problem is that usually the compression algorithm is very expensive if you want to really get a interesting factor of size reduction. And there is the tradeoff, what you save

Re: [OMPI users] Message compression in OpenMPI

2008-04-24 Thread Jeff Squyres
On Apr 24, 2008, at 8:26 AM, Tomas Ukkonen wrote: Yes, you are probably right that its not worth the effort in general and especially not in HPC environments where you have very fast network. But I can think of (rather important) special cases where it is important - non HPC environments

Re: [OMPI users] Message compression in OpenMPI

2008-04-24 Thread Tomas Ukkonen
George Bosilca wrote: > The paper you cited, while presenting a particular implementation > doesn't bring present any new ideas. The compression of the data was > studied for long time, and [unfortunately] it always came back to the > same result. In the general case, not worth the effort ! > > Now

Re: [OMPI users] Message compression in OpenMPI

2008-04-24 Thread Tomas Ukkonen
Jeff Squyres wrote: > On Apr 22, 2008, at 9:03 AM, Tomas Ukkonen wrote: > >> I read from somewhere that OpenMPI supports >> >> some kind of data compression but I couldn't find >> any information about it. >> >> Is this true and how it can be used? >> > Nope, sorry -- not true. > > This jus

Re: [OMPI users] Message compression in OpenMPI

2008-04-22 Thread George Bosilca
The paper you cited, while presenting a particular implementation doesn't bring present any new ideas. The compression of the data was studied for long time, and [unfortunately] it always came back to the same result. In the general case, not worth the effort ! Now of course, if one limit i

Re: [OMPI users] Message compression in OpenMPI

2008-04-22 Thread Jeff Squyres
On Apr 22, 2008, at 9:03 AM, Tomas Ukkonen wrote: I read from somewhere that OpenMPI supports some kind of data compression but I couldn't find any information about it. Is this true and how it can be used? Nope, sorry -- not true. This just came up in a different context, actually. We ad