Re: rsync memory usage with block-size option

2013-02-28 Thread Jarrid Graham
OK it is the text dump, uncompressed, looks like the new maint. plan does a rebuild index then a reorganize index. Of course I do not know a lot about SQL, but when I watch the rsync run most of the data is generated in the last 25% of the run, I know the data is the same in there but maybe now it

Re: rsync memory usage with block-size option

2013-02-28 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 When you say an SQL database dump do you mean you are rsyncing the raw text file or are you compressing it? If you are compressing it you might want to try gzip with the --rsyncable patch as it can significantly improve rsync's ability to delta-xfer c

rsync memory usage with block-size option

2013-02-28 Thread Jarrid Graham
I have been using rsync to sync a SQL database dump(127GB in size) on a server (cygwin to linux) for many years now w/o a problem, until they put a maintence plan to reindex the database once a week. This is all done over a 2Mbit link normally took 3-4 hrs now I noticed it was running the next d