Re: [zfs-discuss] zfs send and dedupe

2011-09-07 Thread Edward Ned Harvey
> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- > boun...@opensolaris.org] On Behalf Of Freddie Cash > > Will be interesting to see whether or not -D works with ZFSv28 in FreeBSD 8- > STABLE/9-BETA. And whether or not "zfs send" is faster/better/easier/more > reliable than rsynci

Re: [zfs-discuss] zfs send and dedupe

2011-09-07 Thread Lori Alt
On 09/ 7/11 02:20 PM, Daniel Carosone wrote: On Wed, Sep 07, 2011 at 08:47:36AM -0600, Lori Alt wrote: On 09/ 6/11 11:45 PM, Daniel Carosone wrote: My understanding was that 'zfs send -D' would use the pool's DDT in building its own, if present. It does not use the pool's DDT, but it does use

Re: [zfs-discuss] zfs send and dedupe

2011-09-07 Thread Daniel Carosone
On Wed, Sep 07, 2011 at 08:47:36AM -0600, Lori Alt wrote: > On 09/ 6/11 11:45 PM, Daniel Carosone wrote: >> My understanding was that 'zfs send -D' would use the pool's DDT in >> building its own, if present. > It does not use the pool's DDT, but it does use the SHA-256 checksums > that have alre

Re: [zfs-discuss] zfs send and dedupe

2011-09-07 Thread Freddie Cash
Thanks for the replies everyone. That was along the lines of what I was thinking (-D is a "win" for network usage savings, if it works) but wanted to double-check before I started playing with out new boxes. Will be interesting to see whether or not -D works with ZFSv28 in FreeBSD 8-STABLE/9-BETA

Re: [zfs-discuss] zfs send and dedupe

2011-09-07 Thread Lori Alt
On 09/ 6/11 11:45 PM, Daniel Carosone wrote: On Tue, Sep 06, 2011 at 10:05:54PM -0700, Richard Elling wrote: On Sep 6, 2011, at 9:01 PM, Freddie Cash wrote: For example, does 'zfs send -D' use the same DDT as the pool? No. My understanding was that 'zfs send -D' would use the pool's DDT in b

Re: [zfs-discuss] zfs send and dedupe

2011-09-07 Thread Edward Ned Harvey
> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- > boun...@opensolaris.org] On Behalf Of Richard Elling > > For example, does 'zfs send -D' use the same DDT as the pool? > > No. > > > Or does it require more memory for it's own DDT, thus impacting > performance of both? > > Yes

Re: [zfs-discuss] zfs send and dedupe

2011-09-06 Thread Daniel Carosone
On Tue, Sep 06, 2011 at 10:05:54PM -0700, Richard Elling wrote: > On Sep 6, 2011, at 9:01 PM, Freddie Cash wrote: > > > For example, does 'zfs send -D' use the same DDT as the pool? > > No. My understanding was that 'zfs send -D' would use the pool's DDT in building its own, if present. If bloc

Re: [zfs-discuss] zfs send and dedupe

2011-09-06 Thread Richard Elling
On Sep 6, 2011, at 9:01 PM, Freddie Cash wrote: > Just curious if anyone has looked into the relationship between zpool dedupe, > zfs zend dedupe, memory use, and network throughput. > Yes. > For example, does 'zfs send -D' use the same DDT as the pool? > No. > Or does it require more memory

[zfs-discuss] zfs send and dedupe

2011-09-06 Thread Freddie Cash
Just curious if anyone has looked into the relationship between zpool dedupe, zfs zend dedupe, memory use, and network throughput. For example, does 'zfs send -D' use the same DDT as the pool? Or does it require more memory for it's own DDT, thus impacting performance of both? If you have a dedup