Re: how to reduce rsync system usage

2005-05-30 Thread Paul Slootman
On Mon 30 May 2005, dtra wrote: > > ok i did all as suggested, and tried > rsync -a [EMAIL PROTECTED]::rsync_module/ /path/to/bak/ > and > rsync -a --password-file=/path/to/pwfile [EMAIL PROTECTED]::rsync_module/ > /path/to/bak/ > > but it says @ERROR: access denied to rsync_module from unknown

Re: how to reduce rsync system usage

2005-05-29 Thread dtra
On Fri 27 May 2005, dtra wrote: when i try this, it says unable to find rsyncd.conf nice -n 19 rsync -a --rsh="ssh -l remoteuser -c blowfish" rsyncuser example.com::rsync_module/files /path/to//bak// Wayne's point of saying "use a daemon" (to paraphrase a bit :-) is to eliminate use of ssh.

Re: how to reduce rsync system usage

2005-05-27 Thread Paul Slootman
On Fri 27 May 2005, dtra wrote: > when i try this, it says unable to find rsyncd.conf > nice -n 19 rsync -a --rsh="ssh -l remoteuser -c blowfish" > [EMAIL PROTECTED]::rsync_module/files /path/to/bak/ Wayne's point of saying "use a daemon" (to paraphrase a bit :-) is to eliminate use of ssh. By e

Re: how to reduce rsync system usage

2005-05-27 Thread Joost van den Broek
No daemon required when using ssh. So you would specify the following: [EMAIL PROTECTED]:/path/to/webserver /path/to/bak/ (the --rsh parameter you specified is afaik correct) - Joost On Friday 27 May 2005 07:27, dtra wrote: > sorry, you're prolly tired of me by now > when i try this, it says unab

Re: how to reduce rsync system usage

2005-05-26 Thread dtra
Wayne Davison wrote: On Thu, May 26, 2005 at 06:16:03PM +1000, dtra wrote: yes, i'm using a the daemon on the host the rsync call is nice -n 19 rsync -a [EMAIL PROTECTED]:/path/to/vhosts/site /path/to/bak/ That call does not make use of a daemon -- that would require :: instead of :

Re: how to reduce rsync system usage

2005-05-26 Thread Wayne Davison
On Thu, May 26, 2005 at 06:16:03PM +1000, dtra wrote: > yes, i'm using a the daemon on the host > the rsync call is > nice -n 19 rsync -a [EMAIL PROTECTED]:/path/to/vhosts/site > /path/to/bak/ That call does not make use of a daemon -- that would require :: instead of : (and an appropriate module

Re: how to reduce rsync system usage

2005-05-26 Thread dtra
Wayne Davison wrote: On Thu, May 26, 2005 at 05:06:24PM +1000, dtra wrote: does running the daemon with nice affect the receiving server? cos that's where the main problems lie Obviously, using nice on the daemon affects just the daemon (if you're using a daemon -- you still didn't sa

Re: how to reduce rsync system usage

2005-05-26 Thread Wayne Davison
On Thu, May 26, 2005 at 05:06:24PM +1000, dtra wrote: > does running the daemon with nice affect the receiving server? > cos that's where the main problems lie Obviously, using nice on the daemon affects just the daemon (if you're using a daemon -- you still didn't say for sure). So, I have no id

Re: how to reduce rsync system usage

2005-05-26 Thread dtra
Wayne Davison wrote: On Thu, May 26, 2005 at 10:52:41AM +1000, dtra wrote: the cron job uses nice -19 rsync [...] sorry, one more thing, on the server we are getting the files from, max connections is set to 1 Are you connecting to an rsync daemon or not? If you are running a daemon,

Re: how to reduce rsync system usage

2005-05-25 Thread Wayne Davison
On Thu, May 26, 2005 at 10:52:41AM +1000, dtra wrote: > the cron job uses nice -19 rsync > [...] > sorry, one more thing, on the server we are getting the files from, > max connections is set to 1 Are you connecting to an rsync daemon or not? If you are running a daemon, run the *daemon* as "nice

Re: how to reduce rsync system usage

2005-05-25 Thread zhijiang tian
I would suggest that your script that calls the various rsync commands creates a lockfile and whatever script that is spawning off the additional rsync processes waits until this lockfile is gone before doing anything. Ray On Thu, May 26, 2005 at 10:52:41AM +1000, dtra wrote: > dtra wrote: > > >

Re: how to reduce rsync system usage

2005-05-25 Thread zhijiang tian
dtra wrote: > hi all > > we're using rsync to backup our web server at the moment using it in a > cron job > the server we are using to receive all the sync files is a live but > not heavily used linux machine > but rsync still takes up more resources than we want it to > it takes up to 95% (flu

Re: how to reduce rsync system usage

2005-05-25 Thread dtra
Andrew Gideon wrote: dtra wrote: but rsync still takes up more resources than we want it to it takes up to 95% (fluctuating) cpu load and a fair bit of memory too the cron job uses nice -19 rsync but that doesn't seem to do anything, is there anyway to make it use like 5% cpu or something?

Re: how to reduce rsync system usage

2005-05-25 Thread Andrew Gideon
dtra wrote: > but rsync still takes up more resources than we want it to > it takes up to 95% (fluctuating) cpu load and a fair bit of memory too > > the cron job uses nice -19 rsync > but that doesn't seem to do anything, is there anyway to make it use > like 5% cpu or something? If the other u

Re: how to reduce rsync system usage

2005-05-25 Thread Ray Van Dolson
I would suggest that your script that calls the various rsync commands creates a lockfile and whatever script that is spawning off the additional rsync processes waits until this lockfile is gone before doing anything. Ray On Thu, May 26, 2005 at 10:52:41AM +1000, dtra wrote: > dtra wrote: > > >

Re: how to reduce rsync system usage

2005-05-25 Thread dtra
dtra wrote: hi all we're using rsync to backup our web server at the moment using it in a cron job the server we are using to receive all the sync files is a live but not heavily used linux machine but rsync still takes up more resources than we want it to it takes up to 95% (fluctuating) cp

how to reduce rsync system usage

2005-05-25 Thread dtra
hi all we're using rsync to backup our web server at the moment using it in a cron job the server we are using to receive all the sync files is a live but not heavily used linux machine but rsync still takes up more resources than we want it to it takes up to 95% (fluctuating) cpu load and a f