Re: Speeding Up Rsync for Large File Sets

2012-12-03 Thread Tim Gustafson
have at least one tree of folders with a zillion files in it. -- Tim Gustafson t...@soe.ucsc.edu 831-459-5354 Baskin Engineering, Room 313A -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsy

Re: Speeding Up Rsync for Large File Sets

2012-11-30 Thread Tim Gustafson
> If you are using zfs then why not use zfs send and zfs receive? > > Rsync has to stat every file on both ends which can take a long time > with millions of files. The zfs tools don't have to do any of that. Because zfs send/receive doesn't work well if the target file system ever gets changed,

Speeding Up Rsync for Large File Sets

2012-11-30 Thread Tim Gustafson
hours. Is there any way to speed up the transfer? The command line I'm using is: /usr/local/bin/rsync --stats --rsh=/usr/bin/rsh --recursive --delete --one-file-system --xattrs --links --hard-links --times --perms --owner --group --exclude=.zfs /foo/bar root@remote:/foo/bar Thanks! -- Tim G