-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Are you also using --partial-dir ?

I discussed this problem with someone recently in #rsync and IIRC the
solution was to not use --partial-dir

On 04/17/13 16:40, John Pierman wrote:
> I am backing up a LARGE data set, over a very unstable internet
> connection.
> 
> I NEED to --delay-updates, because I do a flash cut-over once
> everything has transferred. Yes I know --copy-dest does this, but
> if the connection breaks, anything that's already made it over gets
> put into place (not what I want), I need it to go from beginning to
> end, And then I handle the files seperately.
> 
> If I use --partial and --delay-updates together (I get the desired 
> effect, and all is well)......EXCEPT for.....
> 
> Let's say I have 10k files I start my rsync and get through 2k
> files and the internet connection is lost.
> 
> Everything is fine, my partial files are safe, nothing has been
> moved into place yet, I'm happy.
> 
> So I restart rsync (well a script does once the internet comes
> back). Here is where I get unwanted behavior. This rsync run LOOKS
> like it is starting from the beginning (transferring those first 2k
> files INSANELY fast if you look at --progress), which I realize
> it's not really TRANSFERRING anything but it's CHECKING all my
> partial files that haven't been put into place yet.
> 
> The problem is, my connection is dog slow and unreliable (I can't
> change this). If the connection drops frequently I'm basically
> spending too much time (re-hashing?) those files I already have,
> and not picking up where I left off.
> 
> I'm sure there's something I can do to get the desired behavior of 
> picking up where I left off without rehashing the first 2k files??
> 
> Help?
> 
> 

- -- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
        Kevin Korb                      Phone:    (407) 252-6853
        Systems Administrator           Internet:
        FutureQuest, Inc.               ke...@futurequest.net  (work)
        Orlando, Florida                k...@sanitarium.net (personal)
        Web page:                       http://www.sanitarium.net/
        PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlFvCXoACgkQVKC1jlbQAQckZgCeKeYPZ74xl1VD5LzwRxbJUoki
GawAnR/n3vczCLNk2+WO/HWWvZzzgdip
=9VH8
-----END PGP SIGNATURE-----
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Reply via email to