Sean Park wrote:
Sorry. I should provide more info. I'm using s3cmd-0.9.9 and I received this error messages when tring to upload 2GB files. It is intermmitent issues and sometimes works and sometimes doesn't.
I had a similar problem when I first started using s3cmd. I posted a question on the amazon developers board and was told there that it was "best practice" to, when possible, split your file into more manageable sizes--like what ever you can comfortably push into the cloud in no more than a couple of minutes.
You can then reassemble the pieces using an EC instance, if you need the full file intact.
I use S3 for our remote backups, so I use split to chunk up the dump files into 10MB hunks. These push up in about 80 seconds on our 1MB up cable connection. Note that this isn't a guarantee of success--I still get instances where the file will not upload first go so after I put all the files up I run a sync to double check that everything has been placed in the bucket.
Here's where I think we need a set of exit codes so that I can programatically loop back if the file upload does fail. Right now when a put fails it kicks me out of my upload loop so I am sometimes faces with syncing another couple thousand files.
put works better for me because I can pause the upload during business hours, otherwise s3cmd uses a whole lot of our available bandwidth when we have people here trying to work. sync does get the files but I can't check the time before each upload beings like I can in a loop around put.
But that's a little off-topic for this message. Hope that helps, Jeff
s3cmd -v put <filename> s3://bucket/name/<filename> INFO: Compiling list of local files... INFO: Applying --exclude/--include INFO: Summary: 1 local files to upload INFO: Sending file 'filename', please wait...WARNING: Upload failed: /bucket/name/filename ((104, 'Connection reset by peer'))WARNING: Retrying on lower speed (throttle=0.01) WARNING: Waiting 3 sec... INFO: Sending file 'filename', please wait...ERROR: S3 error: 403 (RequestTimeTooSkewed): The difference between the request time and the current time is too large. Is it similar to Timeout? Thank you very much in advance.------------------------------------------------------------------------From: dlz...@live.com To: s3tools-general@lists.sourceforge.net Date: Mon, 5 Oct 2009 07:19:26 -0400 Subject: [S3tools-general] 403 RequestTimeTooSkewedHello, I'm having 403 (RequestTimeTooSkewed) error message often. > ERROR: S3 error: 403 (RequestTimeTooSkewed): The difference between the request time and the current time is too large. Do you know why it usually happens? Thank you very much.------------------------------------------------------------------------Hotmail: Powerful Free email with security by Microsoft. Get it now. <http://clk.atdmt.com/GBL/go/171222986/direct/01/>------------------------------------------------------------------------Your E-mail and More On-the-Go. Get Windows Live Hotmail Free. Sign up now. <http://clk.atdmt.com/GBL/go/171222985/direct/01/> !DSPAM:4aca33bf26948634750119!------------------------------------------------------------------------ ------------------------------------------------------------------------------ Come build with us! The BlackBerry® Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart yourdeveloping skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9-12, 2009. Register now!http://p.sf.net/sfu/devconf !DSPAM:4aca33bf26948634750119! ------------------------------------------------------------------------ _______________________________________________ S3tools-general mailing list S3tools-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/s3tools-general !DSPAM:4aca33bf26948634750119!
<<attachment: jross.vcf>>
------------------------------------------------------------------------------ Come build with us! The BlackBerry® Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9-12, 2009. Register now! http://p.sf.net/sfu/devconf
_______________________________________________ S3tools-general mailing list S3tools-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/s3tools-general
