Re: [S3tools-general] s3cmd sync memory consumption

2011-05-14 Thread Jason Quick
Diito. I've brought up the issue in a previous posting some time ago, and I know that memory management is in the works. But do you have a timeline at all? It's not my intention to rush things, but the memory usage issue is preventing our application of S3 from working and I've got to either know t

[S3tools-general] s3cmd sync memory consumption

2011-04-29 Thread Joe Auty
Hello, I'm wondering if there are any effective tactics for reducing the memory consumption of s3cmd sync jobs of directories with large amounts of files? I find that these jobs use an order of magnitude more memory than rsync, for instance. I realize that a differe