On Mon, Jun 20, 2011 at 10:25 AM, Mark Knecht <markkne...@gmail.com> wrote: > Hi, > Is split an appropriate program to use to break a single 10GB file > into 100 100MB files to transfer over the net using rsync, and then > use cat to reassemble?
I think it should work just fine. I've split huge files into huge chunks and never had any issues. > Is there some better way to do this? I wonder if splitting is even necessary; rsync will analyze the file and only transmit the differences, right?. So I'd think that even if the transfer fails, a retry would pick up where it left off (assuming rsync keeps the failed copy). Also check out net-misc/unison. It seems to be designed for just this sort of thing.
