> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- > boun...@opensolaris.org] On Behalf Of Mika Borner > > It seems we are hitting a boundary with zfs send/receive over a network > link (10Gb/s). We can see peak values of up to 150MB/s, but on average > about 40-50MB/s are replicated. This is far away from the bandwidth > that > a 10Gb link can offer. > > Is it possible, that ZFS is giving replication a too low > priority/throttling it too much?
I don't think this is called "replication," so ... careful about terminology. zfs send can go as fast as your hardware is able to read. If you'd like to know how fast your hardware is, try this: zfs send somefilesystem | pv -i 30 > /dev/null (You might want to install pv from opencsw or blastwave.) I think, in your case, you'll see something around 40-50MB/s I will also add this much: If you send the original snapshot of your complete filesystem, it'll probably go very fast. (Much faster than 40-50 MB/s). Because all those blocks are essentially sequential blocks on disk. When you're sending incrementals ... They are essentially more fragmented ... so the total throughput is lower. The disks have to perform a greater random IO percentage. I have a very fast server, and my zfs send is about half as fast as yours. In both cases, it's enormously faster than some other backup tool, like tar or rsync or whatever. _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss