Re: [zfs-discuss] Announce: zfsdump

2010-07-05 Thread Joerg Schilling
Tristram Scott wrote: > I see a number of points to consider when choosing amongst the various > suggestions for backing up zfs file systems. In no particular order, I have > these: Let me fill this out for star ;-) > 1. Does it work in place, or need an intermediate copy on disk? Yes > 2.

Re: [zfs-discuss] Announce: zfsdump

2010-07-05 Thread Tristram Scott
> At this point, I will repeat my recommendation about > using > zpool-in-files as a backup (staging) target. > Depending where you > ost, and how you combine the files, you can achieve > these scenarios > without clunkery, and with all the benefits a zpool > provides. > This is another good sch

Re: [zfs-discuss] Announce: zfsdump

2010-07-03 Thread Daniel Carosone
On Wed, Jun 30, 2010 at 12:54:19PM -0400, Edward Ned Harvey wrote: > If you're talking about streaming to a bunch of separate tape drives (or > whatever) on a bunch of separate systems because the recipient storage is > the bottleneck instead of the network ... then "split" probably isn't the > mos

Re: [zfs-discuss] Announce: zfsdump

2010-07-01 Thread Edward Ned Harvey
> From: Asif Iqbal [mailto:vad...@gmail.com] > > currently to speed up the zfs send| zfs recv I am using mbuffer. It > moves the data > lot faster than using netcat (or ssh) as the transport method Yup, this works because network and disk latency can both be variable. So without buffering, your

Re: [zfs-discuss] Announce: zfsdump

2010-06-30 Thread Asif Iqbal
On Wed, Jun 30, 2010 at 12:54 PM, Edward Ned Harvey wrote: >> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- >> boun...@opensolaris.org] On Behalf Of Asif Iqbal >> >> would be nice if i could pipe the zfs send stream to a split and then >> send of those splitted stream over the >>

Re: [zfs-discuss] Announce: zfsdump

2010-06-30 Thread Edward Ned Harvey
> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- > boun...@opensolaris.org] On Behalf Of Asif Iqbal > > would be nice if i could pipe the zfs send stream to a split and then > send of those splitted stream over the > network to a remote system. it would help sending it over to remo

Re: [zfs-discuss] Announce: zfsdump

2010-06-29 Thread Tristram Scott
evik wrote: Reading this list for a while made it clear that zfs send is not a backup solution, it can be used for cloning the filesystem to a backup array if you are consuming the stream with zfs receive so you get notified immediately about errors. Even one bitflip will render the stream unusa

Re: [zfs-discuss] Announce: zfsdump

2010-06-29 Thread Tristram Scott
> > if, for example, the network pipe is bigger then one > unsplitted stream > of zfs send | zfs recv then splitting it to multiple > streams should > optimize the network bandwidth, shouldn't it ? > Well, I guess so. But I wonder, what is the bottle neck here. If it is the rate at which zfs

Re: [zfs-discuss] Announce: zfsdump

2010-06-29 Thread Kyle McDonald
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 6/28/2010 10:30 PM, Edward Ned Harvey wrote: >> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- >> boun...@opensolaris.org] On Behalf Of Tristram Scott >> >> If you would like to try it out, download the package from: >> http://www.qu

Re: [zfs-discuss] Announce: zfsdump

2010-06-29 Thread Asif Iqbal
On Tue, Jun 29, 2010 at 8:17 AM, Tristram Scott wrote: >> >> would be nice if i could pipe the zfs send stream to >> a split and then >> send of those splitted stream over the >> network to a remote system. it would help sending it >> over to remote >> system quicker. can your tool do that? >> >>

Re: [zfs-discuss] Announce: zfsdump

2010-06-29 Thread Tristram Scott
> > would be nice if i could pipe the zfs send stream to > a split and then > send of those splitted stream over the > network to a remote system. it would help sending it > over to remote > system quicker. can your tool do that? > > something like this > >s | ->

Re: [zfs-discuss] Announce: zfsdump

2010-06-28 Thread Asif Iqbal
On Mon, Jun 28, 2010 at 11:26 AM, Tristram Scott wrote: > For quite some time I have been using zfs send -R fsn...@snapname | dd > of=/dev/rmt/1ln to make a tape backup of my zfs file system.  A few weeks > back the size of the file system grew to larger than would fit on a single > DAT72 tape,

Re: [zfs-discuss] Announce: zfsdump

2010-06-28 Thread Edward Ned Harvey
> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- > boun...@opensolaris.org] On Behalf Of Tristram Scott > > If you would like to try it out, download the package from: > http://www.quantmodels.co.uk/zfsdump/ I haven't tried this yet, but thank you very much! Other people have poi

Re: [zfs-discuss] Announce: zfsdump

2010-06-28 Thread Brian Kolaci
On Jun 28, 2010, at 12:26 PM, Tristram Scott wrote: >> I use Bacula which works very well (much better than >> Amanda did). >> You may be able to customize it to do direct zfs >> send/receive, however I find that although they are >> great for copying file systems to other machines, >> they are i

Re: [zfs-discuss] Announce: zfsdump

2010-06-28 Thread Tristram Scott
> I use Bacula which works very well (much better than > Amanda did). > You may be able to customize it to do direct zfs > send/receive, however I find that although they are > great for copying file systems to other machines, > they are inadequate for backups unless you always > intend to restore

Re: [zfs-discuss] Announce: zfsdump

2010-06-28 Thread Brian Kolaci
I use Bacula which works very well (much better than Amanda did). You may be able to customize it to do direct zfs send/receive, however I find that although they are great for copying file systems to other machines, they are inadequate for backups unless you always intend to restore the whole f

[zfs-discuss] Announce: zfsdump

2010-06-28 Thread Tristram Scott
For quite some time I have been using zfs send -R fsn...@snapname | dd of=/dev/rmt/1ln to make a tape backup of my zfs file system. A few weeks back the size of the file system grew to larger than would fit on a single DAT72 tape, and I once again searched for a simple solution to allow dumping