Re: [zfs-discuss] questions on zfs send,receive,backups

2008-11-03 Thread Neal Pollack
On 11/03/08 13:18, Philip Brown wrote: Ok, I think I understand. You're going to be told that ZFS send isn't a backup (and for these purposes I definately agree), ... Hmph. well, even for 'replication' type purposes, what I'm talking about is quite useful. Picture two remote systems, wh

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-11-03 Thread Philip Brown
> Ok, I think I understand. You're going to be told > that ZFS send isn't a backup (and for these purposes > I definately agree), ... Hmph. well, even for 'replication' type purposes, what I'm talking about is quite useful. Picture two remote systems, which happen to have "mostly identical" dat

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-11-03 Thread Ross
Ok, I think I understand. You're going to be told that ZFS send isn't a backup (and for these purposes I definately agree), but if we ignore that this sounds like you're talking about restoring a snapshot from an external media, and then running a clone off that. Clone's are already supported,

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-11-03 Thread Philip Brown
> If > I'm interpreting correctly, you're talking about a > couple of features, neither of which is in ZFS yet, ... > 1. The ability to restore individual files from a > snapshot, in the same way an entire snapshot is > restored - simply using the blocks that are already > stored. > > 2. The a

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-11-03 Thread Ross Smith
>> If the file still existed, would this be a case of redirecting the >> file's top level block (dnode?) to the one from the snapshot? If the >> file had been deleted, could you just copy that one block? >> >> Is it that simple, or is there a level of interaction between files >> and snapshots tha

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-11-03 Thread Richard Elling
Ross Smith wrote: >> Snapshots are not replacements for traditional backup/restore features. >> If you need the latter, use what is currently available on the market. >> -- richard >> > > I'd actually say snapshots do a better job in some circumstances. > Certainly they're being used that way

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-11-03 Thread Ross Smith
> Snapshots are not replacements for traditional backup/restore features. > If you need the latter, use what is currently available on the market. > -- richard I'd actually say snapshots do a better job in some circumstances. Certainly they're being used that way by the desktop team: http://blogs.

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-11-03 Thread Richard Elling
Ross Smith wrote: > Hi Darren, > > That's storing a dump of a snapshot on external media, but files > within it are not directly accessible. The work Tim et all are doing > is actually putting a live ZFS filesystem on external media and > sending snapshots to it. > Cognitive disconnect, again.

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-11-03 Thread Ross Smith
Hi Darren, That's storing a dump of a snapshot on external media, but files within it are not directly accessible. The work Tim et all are doing is actually putting a live ZFS filesystem on external media and sending snapshots to it. A live ZFS filesystem is far more useful (and reliable) than a

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-11-03 Thread Darren J Moffat
Ross wrote: > Ok, I see where you're coming from now, but what you're talking about isn't > zfs send / receive. If I'm interpreting correctly, you're talking about a > couple of features, neither of which is in ZFS yet, and I'd need the input of > more technical people to know if they are possi

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-10-31 Thread Ross
Ok, I see where you're coming from now, but what you're talking about isn't zfs send / receive. If I'm interpreting correctly, you're talking about a couple of features, neither of which is in ZFS yet, and I'd need the input of more technical people to know if they are possible. 1. The abilit

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-10-31 Thread Philip Brown
> Ah, there is a cognitive disconnect... more below. > > The cognitive disconnect is that snapshots are > blocks, not files. > Therefore, the snapshot may contain only changed > portions of > files and blocks from a single file may be spread > across many > different snapshots. I was referring

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-10-31 Thread Richard Elling
Ah, there is a cognitive disconnect... more below. Philip Brown wrote: >> relling wrote: >> This question makes no sense to me. Perhaps you can >> rephrase? >> >> > > To take a really obnoxious case: > lets say I have a 1 gigabyte filesystem. It has 1.5 gigabytes of physical > disk allocate

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-10-31 Thread Philip Brown
> So, when I do a zfs receive, it would be "really > nice", if there were some way for zfs to figure out, > lets say, "recieve to a snapshot of the filesystem; > then take advantage of the fact that it is a > snapshot, to NOT write on disk, the 9 unaltered files > that are in the snapshot; just all

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-10-31 Thread Philip Brown
> relling wrote: > This question makes no sense to me. Perhaps you can > rephrase? > To take a really obnoxious case: lets say I have a 1 gigabyte filesystem. It has 1.5 gigabytes of physical disk allocated to it (so it is 66% full). It has 10x100meg files in it. "Something bad happens", and I

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-10-31 Thread Ross
> > 2.2 do a receive of an earlier zfs send, to > either a snapshot or a "child" filesystem, and be > efficient about disk space used. ie: have the recieve > understand, "hey, I have that file already, > completely intact, so I'm not going to waste space by > storing it again". > > ZFS alread

Re: [zfs-discuss] questions on zfs send,receive,backups

2008-10-30 Thread Richard Elling
Philip Brown wrote: > I've recently started down the road of production use for zfs, and am hitting > my head on some paradigm shifts. I'd like to clarify whether my understanding > is correct, and/or whether there are better ways of doing things. > I have one question for replication, and one qu

[zfs-discuss] questions on zfs send,receive,backups

2008-10-30 Thread Philip Brown
I've recently started down the road of production use for zfs, and am hitting my head on some paradigm shifts. I'd like to clarify whether my understanding is correct, and/or whether there are better ways of doing things. I have one question for replication, and one question for backups. These qu