[S3tools-general] Much slower transfer when throttling

Hello, We're using s3cmd to transfer large files in 10mb chunks. About 80% of the chunks work normally, taking about 90 seconds each (~10-11 MB/s). But about 20% of the chunks fail with "(104, 'Connection reset by peer')", followed by "Retrying on lower speed (throttle=0.01)". The retry reliabl

Re: [S3tools-general] Much slower transfer when throttling

Hi Nigel, > Perhaps it should be sleeping for .001 seconds upon first retry, instead > of .01 seconds? Even better might be to just retry once with no sleep > and then sleep for .001 seconds per chunk on the second retry. give the attached patch a try - it'll make the first re-try without thrott

Re: [S3tools-general] Much slower transfer when throttling

Thanks, Michal -- I'll give this a try tomorrow! Chris On Wed, Jul 8, 2009 at 6:19 PM, Michal Ludvig wrote: > Hi Nigel, > > > Perhaps it should be sleeping for .001 seconds upon first retry, instead > > of .01 seconds? Even better might be to just retry once with no sleep > > and then sleep fo