Re: rsync speed limited by read chunk size?

2013-08-04 Thread AZ 9901
Le 12 juil. 2013 à 19:35, Wayne Davison a écrit : > The fileio routines are usually reading 256K chunks except for the receiver, > which tries to read 16K chunks (since it may be randomly accessing the file > data in some cases). Wayne, when the Rsync daemon accesses the data (randomly or not),

Re: rsync speed limited by read chunk size?

2013-07-29 Thread Wayne Davison
On Sun, Jul 28, 2013 at 1:07 PM, AZ 9901 wrote: > What about my 4K alignment question ? Don't you think it would even be > faster ? > As I said in my last message, reads are in 256K chunks. So, no, alignment won't affect that. ..wayne.. -- Please use reply-all for most replies to avoid omitt

Re: rsync speed limited by read chunk size?

2013-07-28 Thread AZ 9901
Le 13 juil. 2013 à 14:42, AZ 9901 a écrit : > Le 12 juil. 2013 à 19:35, Wayne Davison a écrit : > >> On Tue, Jul 9, 2013 at 9:46 AM, CM Fields wrote: >> Is rsync speed limited to 160MB/sec read speeds due to the chunk read size? >> Or, are we seeing just a coincidence and the limitation is som

Re: rsync speed limited by read chunk size?

2013-07-13 Thread AZ 9901
Le 12 juil. 2013 à 19:35, Wayne Davison a écrit : > On Tue, Jul 9, 2013 at 9:46 AM, CM Fields wrote: >> Is rsync speed limited to 160MB/sec read speeds due to the chunk read size? >> Or, are we seeing just a coincidence and the limitation is somewhere else? > > The fileio routines are usually

Re: rsync speed limited by read chunk size?

2013-07-12 Thread CM Fields
Wayne, We see almost double the speed using rsync 3.1.0dev. 314MB/sec compared to 160MB/sec. ~/rsync/rsync-HEAD-20130623-1942GMT# ./rsync --version rsync version 3.1.0dev protocol version 31.PR14 ./rsync -avP /data1/Fedora-Live-Desktop.iso /data2/ Fedora-Live-Desktop.iso 997,195,776 100%

Re: rsync speed limited by read chunk size?

2013-07-12 Thread Wayne Davison
On Tue, Jul 9, 2013 at 9:46 AM, CM Fields wrote: > Is rsync speed limited to 160MB/sec read speeds due to the chunk > read size? Or, are we seeing just a coincidence and the limitation > is somewhere else? > The fileio routines are usually reading 256K chunks except for the receiver, which tries

Re: rsync speed on slow wireless links

2009-12-23 Thread Wayne Davison
On Wed, Dec 23, 2009 at 1:04 AM, Max Arnold wrote: > Is it worth to try development version in production or it is better to > wait for stabilization? > I'm using the version from Dec 16th in one production setting that is easy to monitor for problems, and it has been doing very well. I'm going

Re: rsync speed on slow wireless links

2009-12-23 Thread Max Arnold
On Mon, Dec 21, 2009 at 10:04:20AM -0800, Wayne Davison wrote: > On Wed, Dec 9, 2009 at 10:08 PM, Max Arnold wrote: > > in my tests rsync often stalls > > for 3-5 minutes, while wget stalls only for several seconds and then > > continues download. Installed rsync-3.1dev snapshot from 20091222 on

Re: rsync speed on slow wireless links

2009-12-21 Thread Matt McCutchen
On Mon, 2009-12-21 at 10:04 -0800, Wayne Davison wrote: > Have you verified that rsync is actually stalled, and not simply > sending incremental file-list information in between files? (e.g. > strace rsync and see what it's doing.) You could try using > --no-inc-recursive to see if doing all the

Re: rsync speed on slow wireless links

2009-12-21 Thread Wayne Davison
On Wed, Dec 9, 2009 at 10:08 PM, Max Arnold wrote: > in my tests rsync often stalls > for 3-5 minutes, while wget stalls only for several seconds and then > continues download. Have you verified that rsync is actually stalled, and not simply sending incremental file-list information in between f

Re: rsync speed on slow wireless links

2009-12-14 Thread Max Arnold
On Mon, Dec 14, 2009 at 02:23:26AM -0500, Matt McCutchen wrote: > On Thu, 2009-12-10 at 13:08 +0700, Max Arnold wrote: > > I've noticed that rsync performs significantly worse than wget on slow > > congested wireless > > links (GPRS in my case). I don't have large statistics, but in my tests > >

Re: rsync speed on slow wireless links

2009-12-13 Thread Matt McCutchen
On Thu, 2009-12-10 at 13:08 +0700, Max Arnold wrote: > I've noticed that rsync performs significantly worse than wget on slow > congested wireless > links (GPRS in my case). I don't have large statistics, but in my tests > rsync often stalls > for 3-5 minutes, while wget stalls only for several

Re: rsync speed

2006-05-23 Thread Julian Pace Ross
-Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]On Behalf Of Julian Pace Ross Sent: Tuesday, May 23, 2006 4:22 AM To: Wayne Davison Cc: rsync@lists.samba.org Subject: Re: rsync speed Pushing the file from Windows to

RE: rsync speed

2006-05-23 Thread Tony Abernethy
Pace RossSent: Tuesday, May 23, 2006 4:22 AMTo: Wayne DavisonCc: rsync@lists.samba.orgSubject: Re: rsync speed Pushing the file from Windows to Linux over ssh takes around 15 min, with an average speed of ~400Kbps (using --progress). Pulling the same file using the same arguments

Re: rsync speed

2006-05-23 Thread Julian Pace Ross
Pushing the file from Windows to Linux over ssh takes around 15 min, with an average speed of ~400Kbps (using --progress). Pulling the same file using the same arguments takes around 45 mins, with an average speed of ~150Kbps. Do you mean pulling it back again from Linux to

Re: rsync speed

2006-05-20 Thread Wayne Davison
On Wed, May 17, 2006 at 09:43:50PM +0200, Julian Pace Ross wrote: > Pushing the file from Windows to Linux over ssh takes around 15 min, with an > average speed of ~400Kbps (using --progress). > > Pulling the same file using the same arguments takes around 45 mins, with an > average speed of ~150K

Re: rsync speed

2003-03-27 Thread jw schultz
On Thu, Mar 27, 2003 at 05:25:06PM -0600, [EMAIL PROTECTED] wrote: > Hi, > > I poked around the website and did some digging in the list archives but > thought i'd better pose my question here. > > I'm using rsync to synchronize two directories on a Solaris 8 e450 server. > rsync copies about 2

Re: Rsync speed over network.

2002-11-12 Thread jw schultz
On Tue, Nov 12, 2002 at 11:03:34AM +0200, Mozzi wrote: > > Haile the list ;-) > > I am new to this list and this is my first post so grretings to all and > nice to meet you. > > I am setting up rsync here to do a MASSIVE copy from one machine to the > other. > I am moving mail servers so I m

Re: rsync-speed with win98

2001-03-22 Thread Robert Scholten
What happens if you do a "dry run", i.e. with the -n option? That way you can tell if it's network-related. I've found that network speed with cygwin stuff is pretty sad. For example, using Tridge's socklib network speed test (bewdiful - thanks Tridge!), I get 2MB/s under Win2k+cygwin, vs. 10MB/