On Sat, Dec 6, 2008 at 11:40 AM, Ian Collins <i...@ianshome.com> wrote: > Richard Elling wrote: >> Ian Collins wrote: >>> Ian Collins wrote: >>>> Andrew Gabriel wrote: >>>>> Ian Collins wrote: >>>>>> I've just finished a small application to couple zfs_send and >>>>>> zfs_receive through a socket to remove ssh from the equation and the >>>>>> speed up is better than 2x. I have a small (140K) buffer on the >>>>>> sending >>>>>> side to ensure the minimum number of sent packets >>>>>> >>>>>> The times I get for 3.1GB of data (b101 ISO and some smaller >>>>>> files) to a >>>>>> modest mirror at the receive end are: >>>>>> >>>>>> 1m36s for cp over NFS, >>>>>> 2m48s for zfs send though ssh and >>>>>> 1m14s through a socket. >>>>>> >>>>> So the best speed is equivalent to 42MB/s. >>>>> It would be interesting to try putting a buffer (5 x 42MB = 210MB >>>>> initial stab) at the recv side and see if you get any improvement. >>>>> >>> It took a while... >>> >>> I was able to get about 47MB/s with a 256MB circular input buffer. I >>> think that's about as fast it can go, the buffer fills so receive >>> processing is the bottleneck. Bonnie++ shows the pool (a mirror) block >>> write speed is 58MB/s. >>> >>> When I reverse the transfer to the faster box, the rate drops to 35MB/s >>> with neither the send nor receive buffer filling. So send processing >>> appears to be the limit in this case. >> Those rates are what I would expect writing to a single disk. >> How is the pool configured? >> > The "slow" system has a single mirror pool of two SATA drives, the > faster one a stripe of 4 mirrors and an IDE SD boot drive. > > ZFS send though ssh from the slow to the fast box takes 189 seconds, the > direct socket connection send takes 82 seconds. > > -- > Ian. > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss@opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >
Reviving an old discussion, but has the core issue been addressed in regards to zfs send/recv performance issues? I'm not able to find any new bug reports on bugs.opensolaris.org related to this, but my search kung-fu may be weak. Using mbuffer can speed it up dramatically, but this seems like a hack without addressing a real problem with zfs send/recv. Trying to send any meaningful sized snapshots from say an X4540 takes up to 24 hours, for as little as 300GB changerate. -- Brent Jones br...@servuhome.net _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
