On 10/30/2010 12:52 AM, Martin Wickman wrote: > Using 's3cmd sync' eats up lots of memory. q > > I'm trying to sync some 500.000 files. It gets to about 30% of RAM > before it starts "Retrieving list of remote files" which consumes more > memory until it starts to swap and I have to kill it. Hi Martin,
you're absolutely right, s3cmd is "a bit inefficient" when it comes to memory management. With the current versions the only thing you can do to reduce the memory footprint is to split your upload into chunks, e.g. sync s3://bucket/dir1/ first, then s3://bucket/dir2/, etc. I'm going to work on this after 1.0.0 is released. Michal ------------------------------------------------------------------------------ Nokia and AT&T present the 2010 Calling All Innovators-North America contest Create new apps & games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev _______________________________________________ S3tools-general mailing list S3tools-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/s3tools-general
