Re: --relative clobbers --delete

2011-08-02 Thread Chuck Wolber
On Tue, 2 Aug 2011, Kevin Korb wrote: > 1. Update rsync. You are MANY years out of date. Updating rsync is not > going to break whatever obsolete other stuff you are running. Not an option in this case, but thank you for the suggestion anyway :) > 2. If you are rsyncing from / --relative doe

--relative clobbers --delete

2011-08-02 Thread Chuck Wolber
Hi, We back up a lot of machines with varying version of rsync installed on them. The oldest machine (hopefully soon to be retired) is running rsync version 2.5.7 (protocol version 26). We back this machine up from "/" onwards with a few excludes in there. I noticed today that whenever we use

Re: Multi-Threading?

2011-05-17 Thread Chuck Wolber
On Tue, 17 May 2011, Matt McCutchen wrote: > On Tue, 2011-05-17 at 10:54 -0700, Chuck Wolber wrote: > > > > Abstracting the core functionality into a librsync.so would be really > > spiffy too... > > All easy to say, harder to do (and maintain). I'm thankful th

Re: Multi-Threading?

2011-05-17 Thread Chuck Wolber
On Tue, 17 May 2011, cac...@quantum-sci.com wrote: > In researching this I find that a change to multi-threaded goodness > would require a massive rewrite, and would only be considered for an > rsync replacement. Abstracting the core functionality into a librsync.so would be really spiffy too.

Re: compression of source and target files

2007-09-21 Thread Chuck Wolber
On Fri, 21 Sep 2007, Kenneth Simpson wrote: > Hi - there's a flag for rsync to compress the files in transit - is it > possible to compress one side (target) with gzip and have rsync still > work correctly? It'll still work correctly, but compressing a compressed file can actually make it slig

Access Database

2007-08-16 Thread Chuck Wolber
One of our servers is a CentOS 4 Linux/Samba filesharing server that serves an access database (via a mapped drive) to a client application running on Windows 98. Ever since we started rsync'ing it to back it up every night, it required samba to be restarted after the backup or the clients had

Re: Compression error?

2007-07-19 Thread Chuck Wolber
On Thu, 19 Jul 2007, WCSL wrote: > Seems to work fine without compression -z flag omitted. Is this going through a Watchguard firewall at any point? ..Chuck.. -- http://www.quantumlinux.com Quantum Linux Laboratories, LLC. ACCELERATING Business with Open Technology "The measure of the res

Re: Rysnc Schedule

2007-07-18 Thread Chuck Wolber
On Wed, 18 Jul 2007, sparty2809 wrote: > I understand how to do the rsync part, but how would I delete the files? In linux, you delete files with the "rm" command... In windows you'd probably want to use "deltree"... Or, you could get really fancy and use directed charges of thermite, although

Re: Rysnc Schedule

2007-07-18 Thread Chuck Wolber
On Wed, 18 Jul 2007, sparty2809 wrote: > > What I want to do is use rsync to back up a folder to an external drive. > > I would like to keep 30 days worth. > > For example: I have backups of June 1 - June 30. Once July 1 comes > along, I want to keep June 2 - July 1 and delete June 1, and so f

Re: --hard-links performance

2007-06-05 Thread Chuck Wolber
On Tue, 5 Jun 2007, Paul Slootman wrote: > > In any case, what's the general consensus behind using the > > --hard-links option on large (100GB and above) images? Does it still > > use a ton of memory? Or has that situation been alleviated? > > The size of the filesystem isn't relevant, the num

--hard-links performance

2007-06-05 Thread Chuck Wolber
Have the hard-links optimizations that were described here been implemented? http://lists.samba.org/archive/rsync/2004-January/008137.html In any case, what's the general consensus behind using the --hard-links option on large (100GB and above) images? Does it still use a ton of memory? Or ha

Re: overflow error

2007-05-04 Thread Chuck Wolber
On Fri, 4 May 2007, Wayne Davison wrote: > On Tue, Apr 03, 2007 at 02:22:46PM -0500, David Harfst wrote: > > overflow: flags=0x69 l1=110 12=1633837871 lastname= > > ERROR: buffer overflow in receive_file_entry > > rsync error: error allocating core memory buffers (code 22) at util.c(147) > > Th

Re: tcl/tk rsync wrapper planned

2006-10-17 Thread Chuck Wolber
On Tue, 17 Oct 2006, [EMAIL PROTECTED] wrote: > Chuck Wolber wrote: > > I've always wanted to have an api like that, but I've always been wary > > of chasing protocol changes. A wrapper is the simplest way, but it's > > still a bad approach IMHO. libr

Re: tcl/tk rsync wrapper planned

2006-10-17 Thread Chuck Wolber
On Tue, 17 Oct 2006, [EMAIL PROTECTED] wrote: > > Any chance you'd be willing to consider doing it in Java? There's > > already at least one, now unmaintained, Java class wrapper to rsync > > that I know of (not to be confused with the Java implementation of > > rsync, also currently unmaintain

Re: tcl/tk rsync wrapper planned

2006-10-17 Thread Chuck Wolber
On Tue, 17 Oct 2006, [EMAIL PROTECTED] wrote: > we did some research and we would like to try to write a Tcl/Tk wrapper > around rsync. Any chance you'd be willing to consider doing it in Java? There's already at least one, now unmaintained, Java class wrapper to rsync that I know of (not to b

Re: backup system files (and permissions) over ssh

2006-10-12 Thread Chuck Wolber
On Thu, 12 Oct 2006, [EMAIL PROTECTED] wrote: > Quote: "Without root: Use a non-root account and use passwordless sudo > in the script." > > sounds interesting, can you explain how am i suppose to do that ? who > runs the script ? when ? Check the man page for the sudoers file: "man 5 sudoers"

RE: Cygwin rsync to RH rsync server

2006-06-23 Thread Chuck Wolber
On Fri, 23 Jun 2006, Jason Staudenmayer wrote: > So you have it working with cygwin(svr) to cygwin(cli) transfers but not > linux(svr) to cygwin(cli) No, we have it working where we have to set up a tunnel (via ssh) to the cygwin machine and then set up rsync as a daemon with paths pre-specifie

RE: Cygwin rsync to RH rsync server

2006-06-20 Thread Chuck Wolber
On Tue, 20 Jun 2006, Jason Staudenmayer wrote: > Ok, so it's a Cygwin issue. Might I ask if anyone on the list has a > working cygwin/rsync combo they might be able to share. I've tried > downloading some old cygwin versions but so far nothing has been > working. We've gotten it to work, but o

Re: Data Encryption

2006-06-12 Thread Chuck Wolber
On Mon, 12 Jun 2006, Brad Farrell wrote: > Is there a way with rsync to encrypt data at the source before > transmitting? Not talking about the actually transmission, but the data > itself. I've got a few department heads that want their data secured > before it leaves their computer so that n

Deleted Data

2006-04-16 Thread Chuck Wolber
Greetings, When using the --delete argument, is there any way to get rsync to tell me how much data it deleted after a run? ..Chuck.. -- http://www.quantumlinux.com Quantum Linux Laboratories, LLC. ACCELERATING Business with Open Technology "The measure of the restoration lies in the exte

Re: proposed new parameter: --time-limit 5:30

2005-06-15 Thread Chuck Wolber
On Wed, 15 Jun 2005, ches wrote: > I find that rsync is an excellent tool for backing up my large > partitions, often over slower links on the Internet. I run a cron job > every night to update backup mirrors. > > But occasionally I make large changes to the source disk, and the rsync > updat

--one-file-system problem

2005-03-01 Thread Chuck Wolber
rsync commandline: /usr/bin/rsync -e /usr/bin/ssh --archive --compress --sparse --verbose --stats --delete --numeric-ids --partial --relative --one-file-system target.host:/ /destination/path/ target rsync version: 2.6.3 destination rsync version: 2.6.2 The server we're trying to synchron

Re: Inflate Error?

2004-12-15 Thread Chuck Wolber
On Tue, 7 Dec 2004, Wayne Davison wrote: > On Mon, Dec 06, 2004 at 09:38:14AM -0800, Chuck Wolber wrote: > > inflate (token) returned -5 > > You should be able to avoid this error by turning off the --compress > option. Yup, that solved it. > To figure out why it is oc

Re: rsync seems to hang when --delete option is used.

2004-12-09 Thread Chuck Wolber
On Thu, 9 Dec 2004, Tony Shum wrote: > When I use --delete option, it seems to hang for over 8 hours on 4.5Gb > of total data. But when I remove the --delete option, I can see it > starts rsyncing. Has anyone encounter this problem before? What type of filesystem is your data on (ext3, xfs, e

Inflate Error?

2004-12-06 Thread Chuck Wolber
I've been getting this error message for a few days from a customer's server and we can't seem to decipher it. I googled for it and only found references to it with respect to much older versions of rsync. We're running the Debian packaged version of rsync version 2.6.2-3. The customer side is

Dynamic bwlimit

2004-11-05 Thread Chuck Wolber
It would be useful to be able to send a signal to an active rsync process to get it to throttle (up or down) the bwlimit parameter. Is this a pandora's box, or is it useful for an interested party to put some effort into this? -Chuck -- http://www.quantumlinux.com Quantum Linux Laboratorie

Re: Re: rsync 2.6.2 hang (was rsync 2.6.2 crash)

2004-09-28 Thread Chuck Wolber
On Tue, 28 Sep 2004, jim wrote: > Hey, that's pretty funny. Actually, I would much prefer a Linux > environment, but I don't always get what I want. We are primarily a > Windows and HP-UX shop, so it's not so easy get the powers that be to > buy into a Linux box. Bummer, I feel your pain. As f

Re: rsync 2.6.2 hang (was rsync 2.6.2 crash)

2004-09-28 Thread Chuck Wolber
On Tue, 28 Sep 2004, jim wrote: > OK, I set up a new PC with a fresh XP load to be my rsync server. Rsync > by itself seems to work fine (thank God. I'm going nuts.) > > I am still having problems when I throw ssh into the mix. At least now, > things don't crash, but they do hang. The file lis

Re: Anyone syncing database files?

2004-08-24 Thread Chuck Wolber
On Fri, 20 Aug 2004, Loukinas, Jeremy wrote: > Anyone syncing say 18-20gb Oracle dbf files..? We're syncing well over 185 GB of sleepycat BDB files. I'm not sure how well they relate to Oracle files. -Chuck -- http://www.quantumlinux.com Quantum Linux Laboratories, LLC. ACCELERATING Busin

Berkley DB

2004-07-17 Thread Chuck Wolber
We are rsync'ing large (hundreds of GB) and constantly changing Berkley DB (aka Sleepycat) datasets (the RPM database uses the same thing, but its dataset is extremely small). When a change occurs (insert, update, delete, etc) in a BDB it has a tendency to propagate through the binary database

Re: Help: rsync queries

2004-07-16 Thread Chuck Wolber
On Fri, 16 Jul 2004, Chuck Wolber wrote: > > 5. I want to know If rsync Server is receiving the data of around 1 > > GB every day what is harware configuration recommended for the better > > performance. > > We maintain just under 1TB per server with 20 or 30 backup

Re: Help: rsync queries

2004-07-16 Thread Chuck Wolber
On Fri, 16 Jul 2004, Swapnil wrote: > 1. I want to know whether rsync server and client are available for > * Novell servers > * Windows 2003 > * Windows 2000 server > * Windows NT > * Windows XP > * Xservers > * Mac OS X > * Mac OS 9 I am unaware

Re: Backup script

2004-07-08 Thread Chuck Wolber
On Thu, 8 Jul 2004, spivkid wrote: > I guess I need a full copy of the data that is need to be backup from > the remote box on my local box so rsync can compare the file different > each date? Not really. Having no data on the remote box means that there's more to transfer across from the sour

Re: Realtime rsyncing

2004-07-05 Thread Chuck Wolber
On Mon, 5 Jul 2004, Henry van der Beek wrote: > Hi, I am trying to synchronise two directories on separate machines > across a network using rsync, but I want to apply rsync whenever the > contents of the directories are altered, rather than using a cron job. > Does anyone have any ideas? We are r

Re: faq-o-matic gone

2004-05-27 Thread Chuck Wolber
On Thu, 27 May 2004, John Taylor wrote: > If someone were to start maintaining a FAQ, I might be interested in > helping out. Also, I really hate faq-o-matic. I like the plain ole > flat file FAQ in html. Amen! -Chuck -- http://www.quantumlinux.com Quantum Linux Laboratories, LLC. ACCELE

New Error

2004-05-17 Thread Chuck Wolber
I've never seen this one before. I'm using rsync 2.6.2 on both ends. Server (Athlon, 768MB RAM) checks out just fine. The only anomoly appears to be that this process has been running for 248268.43 seconds (this is not unexpected with this particular host we're backing up). Commandline: /usr

Re: Would this patch be useful...

2004-05-14 Thread Chuck Wolber
On Fri, 14 May 2004, Wayne Davison wrote: > On Tue, May 11, 2004 at 11:41:02AM -0400, John Taylor wrote: > > I am considering a patch that would exclude compressing a given list > > of file extensions when the -z option is used. > > Well, since the daemon code has this, it makes sense to at least

Re: rsync and Perl programming

2004-05-05 Thread Chuck Wolber
On Wed, 5 May 2004, Jim Salter wrote: > Hi everybody - > > I'm trying to write a Perl wrapper for some rsync tasks that need doing. > Problem is, there's some sort of odd interaction going on between Perl > and the daemon mode communication for the rsync client, and I'm at my > wit's end in try

Re: Feature Request

2004-04-27 Thread Chuck Wolber
of status when SIGUSR1 > is sent. Is this accurate? > > -John > > On Tue, Apr 27, 2004 at 02:54:43PM -0700, Chuck Wolber wrote: > > > > Just built 2.6.1 and started testing it. Nice job guys. I especially love > > the --progress and hardlink tweaks. > >

Feature Request

2004-04-27 Thread Chuck Wolber
Just built 2.6.1 and started testing it. Nice job guys. I especially love the --progress and hardlink tweaks. Quite often, while I have systems backing up out of cron, I'd love to be able to see the --progress. Unfortunately, it's just not practical to crank up the verbosity like that on a regula

Re: [PATCH] time limit

2004-04-21 Thread Chuck Wolber
On Tue, 20 Apr 2004, Daemian Mack wrote: > That's more or less the "ugly hack" referred to previously. It does > work as expected, but personally, I'd rather there were a native rsync > method of achieving this. Less kludgy. What might be even better is if there were a cleaner API that rsync ex

Re: [PATCH] time limit

2004-04-19 Thread Chuck Wolber
On Mon, 19 Apr 2004, Wayne Davison wrote: > On Mon, Apr 19, 2004 at 04:28:08PM -0400, John Taylor wrote: > > I have written a patch for rsync-2.6.1pre-2 which adds a > > --time-limit=T option. > > Thanks -- I've added it to the patches dir for now. If folks think it > is useful, it will eventual

Re: Where is my bottleneck?

2004-03-11 Thread Chuck Wolber
On Thu, 11 Mar 2004, Marc Abel wrote: > I don't expect 100 Mbit/s by any means, but 2? Is this typical? What > am I missing? Since it's on a local network segment, you probably don't need to waste the overhead that SSH provides you. In my tests, I was able to get 32 mb/s using plain rsync to th

link-dest

2004-03-08 Thread Chuck Wolber
System is current Debian stable with rsync version: * rsync version 2.6.0 protocol version 27 * Capabilities: 64-bit files, socketpairs, hard links, symlinks, * batchfiles, IPv6, 64-bit system inums, 64-bit internal inums * * Modified for Debian to have --bwlimit-mod, a variation on the --bwli

Re: AW: Full backup

2004-02-06 Thread Chuck Wolber
On Fri, 6 Feb 2004, Thorsten Schacht wrote: > Sounds goot but I do not need 'one' backup folder. Not an iso. What I > actually mean is that there is a identical clone of the current mail > server. The backups are made into a "folder", but then you chroot into that folder and run the environment

Re: Full backup

2004-02-06 Thread Chuck Wolber
On Fri, 6 Feb 2004, Thorsten Schacht wrote: > Hey guys, > > I'd like to take a full backup of our email server. Is it possible to > clone the current server (postfix, spamassassin, qpopper...) to another > clean system to have it ready if the current one fails? Yes. In fact we offer that to our

Re: Rsync's Speed

2004-01-22 Thread Chuck Wolber
> During my initial download for my home directory backup, it took rsync > over 6 hours to do the initial backup, but I can FTP the stuff in about > 30 Mins. Is Rsync usualy this slow? I have compression turned on, and > its across a 100 MB/S network, Anyone had this problem before? In this cas

Re: Buffer Overflow?

2004-01-18 Thread Chuck Wolber
> Maybe it is time to upgrade. Yes, that's the plan. I just figured the list was interested in the message. -Chuck -- http://www.quantumlinux.com Quantum Linux Laboratories, LLC. ACCELERATING Business with Open Technology "The measure of the restoration lies in the extent to which we a

Buffer Overflow?

2004-01-17 Thread Chuck Wolber
Just got this from our nightly backup rsync: overflow: flags=0x6e l1=99 l2=1952984691 lastname=var/www/manual/mod/mod_php4/de/function.get-exte ERROR: buffer overflow in receive_file_entry rsync error: error allocating core memory buffers (code 22) at util.c(238) Command exited with non-zero s

Re: rsync backup

2004-01-15 Thread Chuck Wolber
> I've setup SSH for auto login. It seems I can just do > > rsync -e ssh -aupg 10.10.10.24:/home/MYDOMAIN /home fine > > Do I still need /etc/rsyncd.conf on the server? Nope. I do the same thing, and I've never needed it. -Chuck -- http://www.quantumlinux.com Quantum Linux Laboratories,

Re: 2.6.0 backwards compatibility

2004-01-15 Thread Chuck Wolber
> I saw on the Release notes that 2.6.0 is using protocol version 27 which > is different than 2.5.7 and 2.5.6. I did a quick peak through the rest > of the release notes and quickly browsed the archives on the list and I > didn't see any notes on how well 2.6.0 works with older versions of > rs

Re: Progress reporting: N more to check

2004-01-13 Thread Chuck Wolber
> A recent posting here got me thinking about having the --progress output > tell the user about how many files were left to go in the transfer. I > submit the attached patch which outputs an extra suffix onto the > progress line at the end of each file's transfer (so it only appears > once per

Re: Shorten long lines in man page options summary

2003-12-29 Thread Chuck Wolber
> One thing that's bugged me is that some of the man page lines in the > options summary are longer than 79 chars and wrap onto the next line. %< SNIP $< SNIP > Comments? Suggestions? I second your point. It's a real pain in the butt to be in a noisy datacenter at 4am with nothing but a conso

Re: Permissions Problems

2003-12-22 Thread Chuck Wolber
> Here's my command copied from a shell script:\ > > rsync --verbose --progress --stats --compress --rsh=/usr/bin/ssh > --recursive --times --perms --links \ > /home/* [EMAIL PROTECTED]:/remotebackups/ It looks like you don't have the --delete in there (which you should have to keep identical

Re: partial transfer

2003-12-18 Thread Chuck Wolber
> I am attempting to use rsync to backup a Win98 laptop to a FreeBSD 4.8 > backup server. I have experienced the same problem at roughly the same > point in the process on two occations. The laptop contains ~2.7Gb of > data. On the first attempt we received this error at 2.3Gb and on the > secon