On 19-7-2010 20:36, Brent Jones wrote: > On Mon, Jul 19, 2010 at 11:14 AM, Bruno Sousa <bso...@epinfante.com> wrote: > >> Hi, >> >> If you can share those scripts that make use of mbuffer, please feel >> free to do so ;) >> >> >> Bruno >> On 19-7-2010 20:02, Brent Jones wrote: >> >>> On Mon, Jul 19, 2010 at 9:06 AM, Richard Jahnel <rich...@ellipseinc.com> >>> wrote: >>> >>> >>>> I've tried ssh blowfish and scp arcfour. both are CPU limited long before >>>> the 10g link is. >>>> >>>> I'vw also tried mbuffer, but I get broken pipe errors part way through the >>>> transfer. >>>> >>>> I'm open to ideas for faster ways to to either zfs send directly or >>>> through a compressed file of the zfs send output. >>>> >>>> For the moment I; >>>> >>>> zfs send > pigz >>>> scp arcfour the file gz file to the remote host >>>> gunzip < to zfs receive >>>> >>>> This takes a very long time for 3 TB of data, and barely makes use the 10g >>>> connection between the machines due to the CPU limiting on the scp and >>>> gunzip processes. >>>> >>>> Thank you for your thoughts >>>> >>>> Richard J. >>>> -- >>>> This message posted from opensolaris.org >>>> _______________________________________________ >>>> zfs-discuss mailing list >>>> zfs-discuss@opensolaris.org >>>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >>>> >>>> >>>> >>> I found builds <130 had issues with TCP. I could reproduce TCP >>> timeouts/socket errors up until I got on 132. I have stayed on 132 so >>> far since I haven't found any other show stoppers. >>> Mbuffer is probably your best bet, I rolled mbuffer into my >>> replication scripts, which I could share if anyone's interested. >>> Older versions of my script are on www.brentrjones.com but I have a >>> new one which uses mbuffer >>> >>> > I can't seem to upload files to my Wordpress site any longer, so I put > it up on Pastebin for now: > > http://pastebin.com/2feviTCy > > Hope it helps others > > > Thanks mate! Bruno
-- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
