The performance of rsync with a huge number of files is greatly determined by every option you are using. So, what is your whole command line?
On 03/19/2018 09:05 AM, Bráulio Bhavamitra via rsync wrote:
> Hi all,
>
> I'm using rsync 3 to copy all files from one disk to another. The files
> were writen by Minio, an S3 compatible opensource backend.
>
> The number of files is dozens of millions, almost each of them within
> its own directory.
>
> Rsync takes a long time, when not several hours, to even start syncing
> files. I already see a few reasons:
> - it first create all directories to put files in, that could be done
> along with the sync
> - it needs to generate the list of all files before starting, and cannot
> start syncing and keep the list generation in a different thread.
>
> Cheers,
> bráulio
>
>
--
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
Kevin Korb Phone: (407) 252-6853
Systems Administrator Internet:
FutureQuest, Inc. ke...@futurequest.net (work)
Orlando, Florida k...@sanitarium.net (personal)
Web page: http://www.sanitarium.net/
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
signature.asc
Description: OpenPGP digital signature
-- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
