-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Ext[34]'s dirindex feature does help but only in that it allows rsync and any other program to read a large directory faster.
On 10/18/11 13:41, Eric Shubert wrote: > On 10/14/2011 02:13 AM, Frank Steiner wrote: >> Hi, >> >> we do a 1:1 backup from our main raid to a backup raid every night with >> >> rsync -a --delete /mnt/raid1/ /mnt/raid2 >> >> rsync is 3.09, filesystems are ext3, OS is SLES 11 SP1. >> >> The rsync process takes several hours, even if no file has changed at >> all. >> Using -vv I see that rsync compares all files every time and that takes >> long for some hundreds of millions of small files. >> >> Can I tell rsync it should not compare files in a directory if the >> directory has not changed, i.e., ctime is the same in source and target? >> >> I.e., when I have a dir x with a subdir y and a file y1 in it, I see: >> >> rsync -avv x z >> created directory z >> delta-transmission disabled for local transfer or --whole-file >> x/ >> x/y/ >> x/y/y1 >> >> on the first run and >> >> rsync -avv x z >> x/y/y1 is uptodate >> >> on every following run. Why does rsync compare y1 again? >> >> I couldn't find a solution in the mailing list or FAQ and when googling. >> I found a mail in this list telling that -a was the culprit and one >> should add -O to fix it, but it doesn't make any difference. >> >> cu, >> Frank >> > > Perhaps using the ext3 dirindex option would help? > - -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ Kevin Korb Phone: (407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Florida k...@sanitarium.net (personal) Web page: http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk6dwooACgkQVKC1jlbQAQekUACg/b11v800EJR7MKicqaqEUphZ JyIAoJj89FI5mICi2YnnIEwP6j5++Aec =Gu2V -----END PGP SIGNATURE----- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html