Hi,

I'm not an rsync expert, other people will confirm or infirm what I'm saying, but I think your problem is that you are using rsync in "stand- alone" mode to copy from and to the same computer. Although that works, in this way rsync won't use it's delta algorithm and so, won't have great performance.

That may be wrong, but what I understood from my readings is that rsync has been made for network transfers from computer A to computer B that always share some of the data. In this configuration and with rsync running in both ends, it will use the delta algorithm to do not transfer all the files, but only the needed pieces of files needed to reconstruct the whole files in the other end. This optimisation aim to save bandwidth first, and have the side effect to be faster than an entire copy because of hard links and other stuff that avoid the computer B to write all of the data.

As I said, I not sure of what I'm saying. I think this is right and that's the reason you don't see any optimisation in your configuration, but I would prefer someone else to confirm my hypothesis.

Best regards,

Vitorio

Le 21 sept. 10 à 09:00, grarpamp a écrit :

I have a 5.5GB file, mostly sparse. Tar performs far[!] better than rsync.
I have no ideas yet, so just an FYI as to current state.
FreeBSD 8.1 i386 zfs
Yes, I know the blocks used differs but don't know why yet, could
be just how zfs does things or related to the large amount of sparseness. There are no media errors, CPU/IO load or anything like that and the source
and dest paths are on the same filesystem.
I've not tested times for files that are, say, 90% full instead of 90% sparse
Though a 50% 35MB file was 8.5x slower than tar and had identical
block counts and sha256 with both.

/usr/bin/time rsync -HaxiS ./a ../
f+++++++++ a
     271.13 real       101.44 user        95.62 sys
l -s ./a ../a ; rm -f ../a
blocks bytes
3625 5535932416 ./a
3769 5535932416 ../a


/usr/bin/time tar -cf - ./a | /usr/bin/time tar -C .. -Sxf -
      57.67 real         1.10 user        27.77 sys
      57.67 real        10.68 user         5.87 sys
l -s ./a ../a ; rm -f ../a
blocks bytes
3625 5535932416 ./a
2977 5535932416 ../a
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html



--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Reply via email to