Re: increasing the write block size for high latency

2014-07-28 Thread L. A. Walsh
Dan Stromberg wrote: On Tue, Jul 8, 2014 at 8:07 AM, Adam Edgar wrote: It seems the issue is indeed in the ssh layer. scp has the same issue and some work has been done in “fixing” that: That's a separate issue. rsync's performance WITHOUT ssh -- running locally is 100 times slo

Re: increasing the write block size for high latency

2014-07-26 Thread Adam Edgar
On Jul 26, 2014, at 2:53 PM, Dan Stromberg wrote: > On Tue, Jul 8, 2014 at 8:07 AM, Adam Edgar wrote: >> It seems the issue is indeed in the ssh layer. scp has the same issue and >> some work has been done in “fixing” that: >> >> http://www.psc.edu/index.php/hpn-ssh >> >> From the papers abst

Re: increasing the write block size for high latency

2014-07-26 Thread Dan Stromberg
On Tue, Jul 8, 2014 at 8:07 AM, Adam Edgar wrote: > It seems the issue is indeed in the ssh layer. scp has the same issue and > some work has been done in “fixing” that: > > http://www.psc.edu/index.php/hpn-ssh > > From the papers abstract: > > SCP and the underlying SSH2 protocol impleme

Re: increasing the write block size for high latency

2014-07-26 Thread L. A. Walsh
Jonathan Aquilina wrote: One thing you that im not seeing factored in is rpm speed of the drives. Since my tests are run on the same machines and drives, such things factor out (as do cpu Hz, memory speeds, controller firmware, ... etc). Make sense? -- Please use reply-all for most repli

Re: increasing the write block size for high latency

2014-07-26 Thread Jonathan Aquilina
One thing you that im not seeing factored in is rpm speed of the drives. On 26 Jul 2014 15:05, "L. A. Walsh" wrote: > Adam Edgar wrote: > >> It seems the issue is indeed in the ssh layer. scp has the same issue and >> some work has been done in “fixing” that: >> >> http://www.psc.edu/index.php/hp

Re: increasing the write block size for high latency

2014-07-26 Thread L. A. Walsh
Adam Edgar wrote: It seems the issue is indeed in the ssh layer. scp has the same issue and some work has been done in “fixing” that: http://www.psc.edu/index.php/hpn-ssh From the papers abstract: Status: O SCP and the underlying SSH2 protocol implementation in OpenSSH is network per

Re: increasing the write block size for high latency

2014-07-08 Thread Adam Edgar
It seems the issue is indeed in the ssh layer. scp has the same issue and some work has been done in “fixing” that: http://www.psc.edu/index.php/hpn-ssh >From the papers abstract: SCP and the underlying SSH2 protocol implementation in OpenSSH is network performance limited by staticall

Re: increasing the write block size for high latency

2014-07-07 Thread A
I'm going to be interested in the answer to this question one of these days real soon, so I did some googling and found this blog: http://gergap.wordpress.com/tag/rsync/ He talks about eliminating ssh and just using rsyncs own protocol to speed up the transfer. I read elsewhere that the encry