Re: rsync memory usage with block-size option

2013-02-28 Thread Jarrid Graham
OK it is the text dump, uncompressed, looks like the new maint. plan does a rebuild index then a reorganize index. Of course I do not know a lot about SQL, but when I watch the rsync run most of the data is generated in the last 25% of the run, I know the data is the same in there but maybe now it

Re: rsync memory usage with block-size option

2013-02-28 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 When you say an SQL database dump do you mean you are rsyncing the raw text file or are you compressing it? If you are compressing it you might want to try gzip with the --rsyncable patch as it can significantly improve rsync's ability to delta-xfer c

Re: Rsync memory usage seems a lot higher than 100bytes/file

2006-06-15 Thread Surer Dink
On 6/15/06, Wayne Davison <[EMAIL PROTECTED]> wrote: On Thu, Jun 15, 2006 at 11:50:52AM -0400, Surer Dink wrote: > Is this because I am using -H and --delete? What is the per-file > overhead when both of these options are used? It depends on what version of rsync you're using. Older versions w

Re: Rsync memory usage seems a lot higher than 100bytes/file

2006-06-15 Thread Wayne Davison
On Thu, Jun 15, 2006 at 11:50:52AM -0400, Surer Dink wrote: > Is this because I am using -H and --delete? What is the per-file > overhead when both of these options are used? It depends on what version of rsync you're using. Older versions would allocate an additional file list for --delete, and

Re: rsync memory usage, paid feature request

2005-07-08 Thread Andrew Burgess
The company I work for uses rsync for backups from client computers, the memory usage is a problem for a lot of them since they're already busy doing other important things (databases, web serving, etc). From the FAQ: out of memory The usual reason for "out of memory" when running rsync is t

Re: rsync memory usage, paid feature request

2005-07-07 Thread Wayne Davison
On Wed, Jul 06, 2005 at 01:13:23AM -0500, Matthew S. Hallacy wrote: > Unfortunately there's no indication of who needs a spare week of > coding time, or how much a week would cost. That's a really old comment, so I'm not sure if it was written by Martin Pool or Dave Dykstra or someone else. I'm

Re: rsync memory usage

2002-07-17 Thread tim . conway
Lutz: This has been a frequent topic of discussion. Wayne Davidson (and probably others) is working on a different way, but currently, this method is integral to rsync, and to change it will be a major revision. For my application, I actually had to write my own syncronization program that

Re: rsync memory usage ...

2001-04-27 Thread Goswin Brederlow
> " " == Cameron Simpson <[EMAIL PROTECTED]> writes: > The other day I was moving a lot of data from one spot to > another. About 12G in several 2G files. Anyway, I interrupted > the transfer because I'd chosen a fairly slow way of doing it, > and wanted to pick up where

RE: rsync memory usage ...

2001-01-24 Thread David Bolen
Cameron Simpson [[EMAIL PROTECTED]] writes: >| Cameron> The other day I was moving a lot of data from one spot to >| Cameron> another. About 12G in several 2G files. [...] >| Cameron> so I used rsync so that its checksumming could speed past >| Cameron> the partially copied file.

Re: rsync memory usage ...

2001-01-24 Thread Cameron Simpson
| Cameron> The other day I was moving a lot of data from one spot to | Cameron> another. About 12G in several 2G files. [...] | Cameron> so I used rsync so that its checksumming could speed past | Cameron> the partially copied file. It spent a long time | Cameron> transferring

Re: rsync memory usage ...

2001-01-24 Thread Martin Schwenke
> "Cameron" == Cameron Simpson <[EMAIL PROTECTED]> writes: Cameron> The other day I was moving a lot of data from one spot to Cameron> another. About 12G in several 2G files. Anyway, I Cameron> interrupted the transfer because I'd chosen a fairly slow Cameron> way of doing it