Please try with newer github.com/s3tools/s3cmd master branch. The socket
timeout (which is what appears to be triggering here) was increased from 10
second in v1.0.0 to 5 minutes now. It's taking S3 longer than 10 seconds
to respond to your copy request.
I'm sending this to the general list for two reasons:
1) are all the timeout errors we are seeing recently primarily coming from
short socket timeouts, maybe from a legacy .s3cfg file where the
socket_timeout value was 10?
2) remote copies are broken for files >5GB. s3cmd will fail to do a remote
copy (from one bucket to another) if the object is >5GB. To do so, we must
use the multipart API, which is not being invoked or remote copy operations
at all right now.
Thanks,
Matt
On Thu, Apr 24, 2014 at 5:14 AM, Tal Ben Ami
<tal.ben...@ravellosystems.com>wrote:
> Hi ,
>
>
>
> I encountered this issue (after new installation from Ubuntu 12.04.4 LTS).
>
> Please advise.
>
>
>
> *s3cmd cp
> s3://Production_Backups/zabbix_on_cloud_backup/zabbix_DB_backup.sql
> s3://Production_Backups/zabbix_on_cloud_backup/zabbix_DB_backup_$cmd.sql*
>
> *WARNING: Retrying failed request:
> /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read
> operation timed out)*
>
> *WARNING: Waiting 3 sec...*
>
> *WARNING: Retrying failed request:
> /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read
> operation timed out)*
>
> *WARNING: Waiting 6 sec...*
>
> *WARNING: Retrying failed request:
> /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read
> operation timed out)*
>
> *WARNING: Waiting 9 sec...*
>
> *WARNING: Retrying failed request:
> /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read
> operation timed out)*
>
> *WARNING: Waiting 12 sec...*
>
> *WARNING: Retrying failed request:
> /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql (The read
> operation timed out)*
>
> *WARNING: Waiting 15 sec...*
>
>
>
> *!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!*
>
> * An unexpected error has occurred.*
>
> * Please report the following lines to:*
>
> * s3tools-b...@lists.sourceforge.net
> <s3tools-b...@lists.sourceforge.net>*
>
> *!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!*
>
>
>
> *Problem: S3RequestError: Request failed for:
> /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql*
>
> *S3cmd: 1.0.0*
>
>
>
> *Traceback (most recent call last):*
>
> * File "/usr/bin/s3cmd", line 2006, in <module>*
>
> * main()*
>
> * File "/usr/bin/s3cmd", line 1950, in main*
>
> * cmd_func(args)*
>
> * File "/usr/bin/s3cmd", line 614, in cmd_cp*
>
> * subcmd_cp_mv(args, s3.object_copy, "copy", "File %(src)s copied to
> %(dst)s")*
>
> * File "/usr/bin/s3cmd", line 607, in subcmd_cp_mv*
>
> * response = process_fce(src_uri, dst_uri, extra_headers)*
>
> * File "/usr/share/s3cmd/S3/S3.py", line 311, in object_copy*
>
> * response = self.send_request(request)*
>
> * File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request*
>
> * return self.send_request(request, body, retries - 1)*
>
> * File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request*
>
> * return self.send_request(request, body, retries - 1)*
>
> * File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request*
>
> * return self.send_request(request, body, retries - 1)*
>
> * File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request*
>
> * return self.send_request(request, body, retries - 1)*
>
> * File "/usr/share/s3cmd/S3/S3.py", line 487, in send_request*
>
> * return self.send_request(request, body, retries - 1)*
>
> * File "/usr/share/s3cmd/S3/S3.py", line 489, in send_request*
>
> * raise S3RequestError("Request failed for: %s" % resource['uri'])*
>
> *S3RequestError: Request failed for:
> /zabbix_on_cloud_backup/zabbix_DB_backup_2014-04-24_12:05.sql*
>
>
>
> *!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!*
>
> * An unexpected error has occurred.*
>
> * Please report the above lines to:*
>
> * s3tools-b...@lists.sourceforge.net
> <s3tools-b...@lists.sourceforge.net>*
>
> *!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!*
>
>
>
>
>
> Thanks,
>
> Tal
>
>
> ------------------------------------------------------------------------------
> Start Your Social Network Today - Download eXo Platform
> Build your Enterprise Intranet with eXo Platform Software
> Java Based Open Source Intranet - Social, Extensible, Cloud Ready
> Get Started Now And Turn Your Intranet Into A Collaboration Platform
> http://p.sf.net/sfu/ExoPlatform
>
------------------------------------------------------------------------------
Start Your Social Network Today - Download eXo Platform
Build your Enterprise Intranet with eXo Platform Software
Java Based Open Source Intranet - Social, Extensible, Cloud Ready
Get Started Now And Turn Your Intranet Into A Collaboration Platform
http://p.sf.net/sfu/ExoPlatform
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general
