regarding dynamic slowdown, you may also have a look at: https://bugzilla.samba.org/show_bug.cgi?id=7120
regards Roland List: rsync Subject: Re: RFC: slow-down option From: Marian Marinov <mm () yuhu ! biz> Date: 2014-04-03 12:52:53 Message-ID: 533D59A5.4080503 () yuhu ! biz [Download message RAW] On 04/03/2014 02:48 PM, Christoph Biedl wrote: > Marian Marinov wrote... > > > I've been using rsync on some backup servers for years. In 2011 we > > had a situation where the FS of the backup server was behaving > > strange, even thou there was enough available I/O, the fs(ext4 on > > 16TB partition with a lot of inodes) was lagging. After much testing > > we found that rsync was hammering the fs too hard. > > I'd like to learn more about that scenario. Mostly, I'm curious > whether these file transfers involved creation of a *lot* and probably > rather small files. The files were *mostly* small files under 10k. We had around 10 concurrent rsyncs \ running at any given time. The fs was build on top of RAID6 array. But unfortunately \ I did not create the journal on separate device and actually did not left any space \ for separate device for the journal, which in my opinion would help in that \ situation. When I did the patch, I was also thinking about a more dynamic slowdown, one that \ would take into account the size of the file that was previously transmitted or the \ size of the file that will be transmitted. Marian > > Christoph > -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
