Re: performance problem of using parallel rsync to stage data from 1 source to multiple destination

2005-09-02 Thread Wayne Davison
Since it sounds like disk I/O is your limiting factor, you may wish to look into updating multiple systems using a batch file. This requires all the receiving systems to have identical files in the destination hierarchy. You would first create a batch file by performing the synchronization either

Re: Status of rsync on win32

2005-09-02 Thread Misha Bergal
Wayne Davison <[EMAIL PROTECTED]> writes: > On Sun, Aug 28, 2005 at 10:15:55AM -0500, Misha Bergal wrote: >> rsync on the server machine makes System process to consume about 90% >> of CPU time. > > If you are sending over a fast network, using -W (--whole-file) will > save you CPU (and disk I/O).

Re: performance problem of using parallel rsync to stage data from 1 source to multiple destination

2005-09-02 Thread Paul Slootman
On Thu 01 Sep 2005, Xuehai Zhang wrote: > > > > If (similar) tasks are run in parallel, then the data of the files being > > handled may still be in the buffer cache so that it doesn't need to get > > read in from disk again. This will save time... > > I agree with you that caching effect might be