On Wed, 2008-12-10 at 12:10 -0800, Jim Searle wrote: > Has there ever been a discussion about parallelizing rsync? We do > some large file transfers across our wan which get done much faster if > we run multiple rsync's at the same time. I wrote a perl script that > traverses the directories and figures out how many files to send with > each rsync process, but this only works properly for the initial copy. > > If we could say "rsync --parallel=8 ..." and as rsync finds a file to > transfer it can open up new socket to do the transfer.
http://lists.samba.org/archive/rsync/2008-November/022187.html For now, your script could run "rsync -ni" to find out which files need to be copied without actually copying them and divide up the work based on that information. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html