Re: rsync 2.5.6 hanging

2003-11-17 Thread Andrew J. Schorr
Hi Zach, On Mon, Nov 17, 2003 at 09:24:12AM -0800, Zachary Denison wrote: > The version I am running on the destination machine is > also rsync 2.5.6. The destination machine has 4GB ram > in it and is running redhat 8.0. Also it gets stuck > on all different types of files, small and large. > s

Re: Feature Request - Recursive Rsync Parameter - Example Script

2003-10-22 Thread Andrew J. Schorr
On Tue, Oct 21, 2003 at 06:46:16PM -0700, jw schultz wrote: > > Limiting the depth of recursion is already supported just > not intuitive. > > rsync -r --exclude='/*/*/*/' > > Your idea for a shell script to automate picking up the > lower levels is good and could compose the --exclude > p

Re: EOF error at io.c line 165

2003-07-30 Thread Andrew J. Schorr
Hi Thomas, On Wed, Jul 30, 2003 at 12:33:45AM -0400, Thomas Cort wrote: > I keep getting rsync: connection unexpectedly closed (1074142 bytes read so far) > rsync error: error in rsync protocol data stream (code 12) at io.c(165). Does > anyone have any idea of what could cause this? I've gotten th

Re: rsync error: error in rsync protocol data stream (Broken pipe)

2003-07-10 Thread Andrew J. Schorr
Just for the record, the patch to token.c for the -z bug that was discovered by Yasuoka Masahiko and patched by him and Wayne Davison has fixed the problem that I reported here: http://www.mail-archive.com/[EMAIL PROTECTED]/msg07289.html Thanks guys, this bug has been biting me for the past 6

Re: rsync error: error in rsync protocol data stream (Broken pipe)

2003-06-18 Thread Andrew J. Schorr
On Tue, Jun 17, 2003 at 06:35:50AM -0700, jw schultz wrote: > > You could try turning on transfer logging i suppose. If you > haven't already done so you might want to use the "log file" > option in case chroot is getting in the way. Beyond this i > have no suggestions; i dont use rsyncd. I may

Re: rsync 2.5.6 still hangs

2003-03-20 Thread Andrew J. Schorr
Steve, I have a couple of comments: 1. In rsync 2.5.5, I found that the -vvv flag can cause repeatable rsync hangs. Since I was using it to debug a real problem, it was very confusing and misleading. But in the end, I determined that -vvv itself was often the culprit. So I caution

Re: rsync and timestamps of local files

2003-03-10 Thread Andrew J. Schorr
On Sat, Mar 08, 2003 at 01:13:17PM -0500, Haisam K. Ido wrote: > Is there a way to make rsync check the local file system for changes in the files > prior to it performing a diff with the remote site? There is no built-in capability to do this in rsync. However, you can implement this yourself.

Re: Filelist caching

2003-02-18 Thread Andrew J. Schorr
Hi Rogier, On Sat, Feb 15, 2003 at 05:05:16PM +0100, Rogier van Eeten wrote: > On Wed, Feb 12, 2003 at 05:18:11PM -0500, Andrew J. Schorr wrote: > > On Wed, Feb 12, 2003 at 10:51:19AM -0500, Andrew J. Schorr wrote: > > > > I was wondering... is there a way to cache that

Re: Filelist caching

2003-02-12 Thread Andrew J. Schorr
On Wed, Feb 12, 2003 at 10:51:19AM -0500, Andrew J. Schorr wrote: > > I've noticed every time someone does an rsync-request on my ftp-site > > (which also provides rsync as mirror method), rsyncd creates a filelist. > > This is a quite IO and CPU intensive procedure

Re: Filelist caching

2003-02-12 Thread Andrew J. Schorr
Hi Rogier, > I've noticed every time someone does an rsync-request on my ftp-site > (which also provides rsync as mirror method), rsyncd creates a filelist. > This is a quite IO and CPU intensive procedure, especially for things > mirrors like FreeBSD with lots of little files. > > I was wonderin

Re: Latest --files-from patch

2003-02-06 Thread Andrew J. Schorr
Hi Wayne, On Sat, Jan 18, 2003 at 10:39:55AM -0800, Wayne Davison wrote: > Cool. Thanks for trying it out. If you do a significant amount of > testing, please let me know so that I can judge when the code has been > shaken down enough for general use. I'm going to do some larger tests > soon my

Re: specifying a list of files to transfer

2003-01-17 Thread Andrew J. Schorr
On Thu, Jan 16, 2003 at 07:06:05PM -0800, jw schultz wrote: > I know i'm not talking about when -R is used. I am talking > about creating implied intermediate directories without -R. > I'm talking about being able to take the output of > find -name '*.jpg' and have it create (if necessary) any > i

Re: specifying a list of files to transfer

2003-01-17 Thread Andrew J. Schorr
On Thu, Jan 16, 2003 at 05:07:13PM -0800, Wayne Davison wrote: > (I assume you're talking about when using -R, which is not currently on > by default.) I believe that we do need an auto-creation mode and also a > way to optimize the transfer to avoid this (since it results in a lot of > extra dire

Re: specifying a list of files to transfer

2003-01-17 Thread Andrew J. Schorr
On Thu, Jan 16, 2003 at 01:58:49PM -0800, jw schultz wrote: > On Thu, Jan 16, 2003 at 02:52:38PM -0600, Dave Dykstra wrote: > > Also, if the transfer is being sent from the remote side, the file names > > are all getting sent over to the remote side first for --files-from and > > then sent back as

Re: Latest --files-from patch

2003-01-16 Thread Andrew J. Schorr
Hi Wayne, I ran a simple test of your patch at http://www.clari.net/~wayne/rsync-files-from.patch and it worked fine for me. The performance was just about the same as for my --source-list patch. Thanks, Andy -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync

Re: rsync hanging with openssh-2.9.9p2 as the transport

2003-01-15 Thread Andrew J. Schorr
On Wed, Jan 15, 2003 at 09:27:37AM -0600, Dave Dykstra wrote: > Unfortunately I don't think anybody is going to be able to tell you. > I've not heard of anybody lately posting a similar problem. In the > past hanging problems have been traced to many different sources. > Rsync stresses network (an

rsync hanging with openssh-2.9.9p2 as the transport

2003-01-14 Thread Andrew J. Schorr
Hi, This is perhaps a stupid question. I apologize in advance if it's already been covered, but I'm stumped... I'm using rsync to backup some file systems to a remote host. The transport is openssh-2.9.9p2. The problem does not occur when the transport is rsh. I'm invoking rsync as follows:

Re: specifying a list of files to transfer

2003-01-14 Thread Andrew J. Schorr
On Tue, Jan 14, 2003 at 03:32:41PM -0600, Dave Dykstra wrote: > I haven't looked at the implementation, but comments on the user > interface: > 1. Yes it should take a filename or - as a parameter. > 2. I don't like the idea of skipping the SRC spec. Paths should be > relative to the

specifying a list of files to transfer

2003-01-14 Thread Andrew J. Schorr
Hi, I don't want to start another --files-from war, but I am attaching an updated version of my patch to allow you to specify a list of files to transfer. The normal rsync syntax allows you to specify a list of SRC files to transfer on the command line. This patch adds some new options to allow

Re: patch to enable faster mirroring of large filesystems

2001-11-26 Thread Andrew J. Schorr
On Sun, Nov 25, 2001 at 03:21:51AM +1100, Martin Pool wrote: > On 20 Nov 2001, Dave Dykstra <[EMAIL PROTECTED]> wrote: > > > > And, by the way, even if the batch stuff accomplishes the same performance > > > gains, I would still argue that the "--files-from" type of behavior > > > that I implemen

patch to enable faster mirroring of large filesystems

2001-11-19 Thread Andrew J. Schorr
I have attached a patch that adds 4 options to rsync that have helped me to speed up my mirroring. I hope this is useful to someone else, but I fear that my relative inexperience with rsync has caused me to miss a way to do what I want without having to patch the code. So please let me know if I