It's great you brought up bbcp. I didn't factor this into my initial email,
but if we could further split up large files into N chunks and transport them
concurrently, that would provide massive benefits as well.
It's clear there are multiple areas for improvement that would let us do away
I'm sure this is a topic that's come up plenty of times before, but is it
possible to implement native parallelization in rsync? There are several blog
posts listing workarounds, but they are largely unideal.
My initial thought would be that rsync could split up the file list across N
worker
