On Mon, Jun 20, 2011 at 2:46 PM, Indi <thebeelzebubtrig...@gmail.com> wrote: > On Mon, Jun 20, 2011 at 08:25:57AM -0700, Mark Knecht wrote: >> Hi, >> Is split an appropriate program to use to break a single 10GB file >> into 100 100MB files to transfer over the net using rsync, and then >> use cat to reassemble? >> >> Is there some better way to do this? >> > > Just using rsync by itself would probably be a great deal faster, > unless you have some undisclosed reason for wanting to split it up.
Hi, Nothing technical that's undisclosed. My original reason was not knowing what rsync did in the case of errors I simply didn't want to start over on such a big file. I figured there was little to lose by stitching it back together are the other end and I could always figure out exactly what file had failed. That said I don't think there's much difference in the speed. In my case (and I think others will have a similar case) my uploads speeds are far lower than download. I get about 8MB/S download but only about 250KB/S upload. It's that low speed that's dominating everything else. When I first tried transferring the big file the intermediate speeds rsync was reporting were very similar. Cheers, Mark
