Hi Julie,
On 05/04/11 03:10, Julie Lin wrote:
When I try to upload a folder with many sub folders (about 7gb)
[...]
MemoryError
unfortunately the s3cmd memory consumption is pretty big. I suggest to
split the upload into smaller chunks. Instead of uploading your floder1
all at once run a sync for folder1/subfldr1, then for folder1/subfldr2,
etc. It doesn't matter how much space the files in each subfolder
occupy, only the number of files in each is relevant. So split the
upload evenly across chunks of directories with roughly the same number
of files if possible.
Michal
------------------------------------------------------------------------------
Forrester Wave Report - Recovery time is now measured in hours and minutes
not days. Key insights are discussed in the 2010 Forrester Wave Report as
part of an in-depth evaluation of disaster recovery service providers.
Forrester found the best-in-class provider in terms of services and vision.
Read this report now! http://p.sf.net/sfu/ibm-webcastpromo
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general
