Re: Speeding Up Rsync for Large File Sets

2012-11-30 Thread Steven Hartland
zfs send receive should work perfectly for this. If the destination has changes you don't mind loosing e.g. just permission changes you can have the receive roll back to the last known source snapshot before replaying changes. The result being two identical copies of everything. If there are oth

Re: Very surprising behaviour with --files-from

2010-12-12 Thread Steven Hartland
- Original Message - From: "Robin Lee Powell" Of course it does, but as I said in my original mail, there are only 4300 directories, and I've seen as much as 10 *million* additional file checks. It turns out it was considering each directory every time *for each file*, because of the o

Re: rsync/cwgwin hangs during transfers

2010-01-17 Thread Steven Hartland
We've never been able to use rsync on cygwin reliably. We tried loads of things and whenever its been brought up on the cygwin list, the answer has always been that its down to issues with pipes implementation, which was a short coming of the underlining OS so nothing that could be fixed. The fre

Re: rsync/cwgwin hangs during transfers

2010-01-16 Thread Steven Hartland
pipes in cygwin are unreliable, its not an rsync issue its a well known cygwin issue. You have two choices: 1. don't use cygwin 2. use daemon mode, which avoids piping though ssh hence the main cause of the pipe issue, although reduces security. Regards Steve - Original Message -

Unable to transfer between win32 (interix) and FreeBSD

2009-04-16 Thread Steven Hartland
While transfering files from a win32 host here running interix aka SFU it keeps constantly failing with various errors see below. Both ends are running 3.0.5 on the same network. Also the transfer speeds are really slow, has anyone had this before and is there anything we can do to investigate th

Re: rsync flags freebsd

2009-03-13 Thread Steven Hartland
Its an option when you install the port. Regards Steve - Original Message - From: "alexus" To: Sent: Friday, March 13, 2009 2:12 AM Subject: rsync flags freebsd is there a way to save special flags in freebsd when using rsync? for example dd# ls -lo init -r-xr-xr-x 1 root

Re: 3.0.3pre2 errors under interix

2008-06-22 Thread Steven Hartland
In addition to this the following is also common:- 132612096 991% 641.09kB/s ??:??:?? Seems to continue transferring rubbish infinitely until restarted. Regards Steve - Original Message - From: "Steven Hartland" <[EMAIL PROTECTED]> To: Sent: Sunday, June

3.0.3pre2 errors under interix

2008-06-22 Thread Steven Hartland
I've been trying to sync two directories under interix between two machines on the local network and I keep getting the flowing errors:- The first error is "failed: Bad address (14)" which always occurs rsync: readlink "/dev/fs/D/Media/Audio/The Hoosiers/desktop.ini" failed: Bad address (14) T

Re: 3.0.3pre2 progress fix doesnt work

2008-06-05 Thread Steven Hartland
- Original Message - From: "Wayne Davison" <[EMAIL PROTECTED]> This looks like a system message overwriting the display, which rsync can't control. We could switch over to writing \r at the start of each progress message rather than at the end, and I may do that for the next release.

3.0.3pre2 fails default-acls test on cygwin

2008-06-04 Thread Steven Hartland
On cygwin 1.5.25 we get the following test failure:- - default-acls log follows Testing for symlinks using 'test -h' sending incremental file list created directory /tmp/rsync-3.0.3pre2/testtmp/default-acls/da777/to delta-transmission disabled for local transfer or --whole-file file program d

3.0.3pre2 compile warnings under cygwin

2008-06-04 Thread Steven Hartland
Under cygwin 1.5.25 we get the following compile warnings flist.c: In function `output_flist': flist.c:2648: warning: unsigned int format, uint32_t arg (arg 4) flist.c:2648: warning: unsigned int format, uint32_t arg (arg 4) flist.c:2655: warning: unsigned int format, uint32_t arg (arg 5) flist.c:

3.0.3pre2 progress fix doesnt work

2008-06-04 Thread Steven Hartland
The progress fix listed [quote] - If rsync exits in the middle of a --progress output, it now outputs a newline to prevent the progress line from being overwritten. [/quote] Appears to not work. == Test 1 == CTRL+C is used to abort:- rsync -av --whole-file --progress -e "ssh -p 23" test

3.0.3pre2 compile warnings on interix

2008-06-04 Thread Steven Hartland
All seems to compile ok but I get the following warnings on interix 3.5 flist.c: In function `recv_file_entry': flist.c:840: warning: comparison between signed and unsigned flist.c:874: warning: comparison between signed and unsigned flist.c:876: warning: right shift count >= width of type flist

Re: rsync using wildcard (*) character

2008-05-29 Thread Steven Hartland
the lines in the file specified to --files-from are actual file names and not patterns so if you want all files starting with xyz then you must specify them all. Regards Steve - Original Message - From: Meeaz To: rsync@lists.samba.org Sent: Thursday, May 29, 2008 2:57

Re: rsync error

2008-04-04 Thread Steven Hartland
Log file is likely locked. - Original Message - From: "Kaushal Shriyan" <[EMAIL PROTECTED]> hi I have the script http://pastebin.com/d4b062d28 and the roots cron entry are as below 30 2 * * * su sms /usr/local/bin/testrsync_mysql.sh I am getting the below error building file list ..

Re: Revised flags patch

2008-03-01 Thread Steven Hartland
- Original Message - From: "Wayne Davison" <[EMAIL PROTECTED]> I have already made a change in a similar vein to the official fileflags patch (mine has the ability to handle immutability of both the oldname file and newname file when renaming). Thanks, though! Thanks for that wayne

Re: Revised flags patch

2008-02-28 Thread Steven Hartland
Attached is a slightly different patch which doesn't attempt chflags to every file, instead it catches the error case in robust_rename and only then calls chflags(to, 0) Hope this helps. Regards Steve - Original Message - From: "Rolf Grossmann" <[EMAIL PROTECTED]> Wayne D

rsync chown/chgrp feature

2008-02-02 Thread Steven Hartland
After looking through all the rsync docs for an option to "set" the owner / group of the files on the destination host, which there doesn't seem to be one, I did a quick Google and turned up the following link. http://lists.samba.org/archive/rsync/2001-October/000327.html This seems to have a pat

Re: RSYNC Hang on client match_sums

2007-08-30 Thread Steven Hartland
age - From: "Alain DESEINE" <[EMAIL PROTECTED]> To: "Steven Hartland" <[EMAIL PROTECTED]>; Sent: Wednesday, August 29, 2007 11:35 PM Subject: Re: RSYNC Hang on client match_sums Hi, Thanks for help ! No big files there ... Sometimes it hang on some hundre

Re: RSYNC Hang on client match_sums

2007-08-29 Thread Steven Hartland
Its not hitting a 2GB file is it? - Original Message - From: "Alain DESEINE" <[EMAIL PROTECTED]> To: Sent: Wednesday, August 29, 2007 10:47 AM Subject: RSYNC Hang on client match_sums Hi, Got a strange problem with rsync ! Here is the story ... I got a linux rsync server running fo

Re: need a rsync patch..!

2007-08-08 Thread Steven Hartland
- Original Message - From: "Matt McCutchen" <[EMAIL PROTECTED]> You might try running your unixy tools under Cygwin ( http://www.cygwin.com/ ) instead of Interix. I know there are a lot of people happily using rsync under Cygwin, and if something goes wrong, there will be a much larger

Re: rsync lockup on windows

2007-06-25 Thread Steven Hartland
Likely to be a problem with cygwin and not rsync. cygwin and rsync over ssh don't play nice. Steve - Original Message - From: "Jerome Haltom" <[EMAIL PROTECTED]> I am using rsync on a Linux box, connecting to a Cygwin SSH server which has Rsync installed, and pulling some files

Infinite loop on files > 2Gb

2007-05-20 Thread Steven Hartland
I'm using rsync to sync DB files from a FreeBSD box to a Windows XP box under interix. Until today everything was fine but now as soon as the windows box hits one file which is now greater than 2Gb it goes into an infinite loop in generator.c:sum_sizes_sqroot The code at fault seems to be: for (