[zfs-discuss] Re: ZFS + rsync, backup on steroids.

2006-09-11 Thread Anton B. Rang
A tool like 'hardlink' will only work for a read-only repository, or one in which files can never be overwritten, only replaced. For true deduplication you really want the underlying file system to have support for 'breaking' the hard link when one file is changed; basically, copy-on-write seman

Re: [zfs-discuss] Re: ZFS + rsync, backup on steroids.

2006-09-11 Thread Tim Foster
hi there, On Sun, 2006-09-10 at 23:49 -0700, Bui Minh Truong wrote: > I'm working on replication of ZFS. Using perl script > and SSH access with authorized key. Cool - I did exactly same thing last week, adding send/receive functionality to the SMF service I had been playing with. More at http:/

[zfs-discuss] Re: ZFS + rsync, backup on steroids.

2006-09-10 Thread Bui Minh Truong
I'm working on replication of ZFS. Using perl script and SSH access with authorized key. My script automatically creates a new snapshot for each ZFS filesystem. It's too slow to send snapshots to remote server. Not because of size of snapshot. Cause SSH with authorized key takes several seconds

Re: [zfs-discuss] Re: ZFS + rsync, backup on steroids.

2006-08-31 Thread Matthew Ahrens
Roch wrote: Matthew Ahrens writes: > Robert Milkowski wrote: > > IIRC unmounting ZFS file system won't flush its caches - you've got to > > export entire pool. > > That's correct. And I did ensure that the data was not cached before > each of my tests. Matt ? It seems to me that (at

Re: [zfs-discuss] Re: ZFS + rsync, backup on steroids.

2006-08-31 Thread Roch
Matthew Ahrens writes: > Robert Milkowski wrote: > > Hello Richard, > > > > Thursday, August 31, 2006, 8:17:41 AM, you wrote: > > > > RLH> Are both of you doing a umount/mount (or export/import, I guess) of > > the > > RLH> source filesystem before both first and second test? Otherwise

Re: [zfs-discuss] Re: ZFS + rsync, backup on steroids.

2006-08-31 Thread Matthew Ahrens
Robert Milkowski wrote: Hello Richard, Thursday, August 31, 2006, 8:17:41 AM, you wrote: RLH> Are both of you doing a umount/mount (or export/import, I guess) of the RLH> source filesystem before both first and second test? Otherwise, there might RLH> still be a fair bit of cached data left o

Re: [zfs-discuss] Re: ZFS + rsync, backup on steroids.

2006-08-31 Thread Robert Milkowski
Hello Richard, Thursday, August 31, 2006, 8:17:41 AM, you wrote: RLH> Are both of you doing a umount/mount (or export/import, I guess) of the RLH> source filesystem before both first and second test? Otherwise, there might RLH> still be a fair bit of cached data left over from the first test, w

[zfs-discuss] Re: ZFS + rsync, backup on steroids.

2006-08-30 Thread Richard L. Hamilton
Are both of you doing a umount/mount (or export/import, I guess) of the source filesystem before both first and second test? Otherwise, there might still be a fair bit of cached data left over from the first test, which would give the 2nd an unfair advantage. I'm fairly sure unmounting a filesyst