> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss-
> boun...@opensolaris.org] On Behalf Of Mika Borner
> 
> It seems we are hitting a boundary with zfs send/receive over a network
> link (10Gb/s). We can see peak values of up to 150MB/s, but on average
> about 40-50MB/s are replicated. This is far away from the bandwidth
> that
> a 10Gb link can offer.
> 
> Is it possible, that ZFS is giving replication a too low
> priority/throttling it too much?

I don't think this is called "replication," so ... careful about
terminology.

zfs send can go as fast as your hardware is able to read.  If you'd like to
know how fast your hardware is, try this:
zfs send somefilesystem | pv -i 30 > /dev/null
(You might want to install pv from opencsw or blastwave.)

I think, in your case, you'll see something around 40-50MB/s

I will also add this much:  If you send the original snapshot of your
complete filesystem, it'll probably go very fast.  (Much faster than 40-50
MB/s).  Because all those blocks are essentially sequential blocks on disk.
When you're sending incrementals ... They are essentially more fragmented
... so the total throughput is lower.  The disks have to perform a greater
random IO percentage.

I have a very fast server, and my zfs send is about half as fast as yours.

In both cases, it's enormously faster than some other backup tool, like tar
or rsync or whatever.

_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Reply via email to