Hi
This sounds like a different memory issue to the one reported in another recent
thread, possibly introduced since 0.9.8 ?
I built s3cmd version 0.9.9 from subversion trunk (r395) on Debian Lenny,
python 2.5.2
Starting with an empty bucket:
s3cmd -v --delete-removed sync /backup s3://bucket
Doesn't even get to start transferring files. About 1 million files, largest
would be in 100s of MBs. Ran off into swap land, so I killed the process before
it dragged my machine down...
When I set 'ulimit -v 768000' (75% of RAM), s3cmd crashes when it cannot
allocate more RAM (traceback below)
Note that with the version which is included in Debian Stable (0.9.8.3-1) file
transfers start OK, although frequently fail due to connection resets, so I was
hoping the updated version better handled the resets. Also I wanted the
--recursive switch for the del command, for which I needed 0.9.9.
# ulimit -v 786432
# s3cmd -v --delete-removed sync /backups s3://bucket/backups
INFO: Compiling list of local files...
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
An unexpected error has occurred.
Please report the following lines to:
s3tools-b...@lists.sourceforge.net
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Traceback (most recent call last):
File "/usr/local/bin/s3cmd", line 1755, in <module>
report_exception(e)
File "/usr/local/bin/s3cmd", line 1695, in report_exception
tb = traceback.format_exc(sys.exc_info())
File "/usr/lib/python2.5/traceback.py", line 236, in format_exc
return ''.join(format_exception(etype, value, tb, limit))
File "/usr/lib/python2.5/traceback.py", line 142, in format_exception
list = list + format_tb(tb, limit)
File "/usr/lib/python2.5/traceback.py", line 76, in format_tb
return format_list(extract_tb(tb, limit))
File "/usr/lib/python2.5/traceback.py", line 101, in extract_tb
line = linecache.getline(filename, lineno, f.f_globals)
File "/usr/lib/python2.5/linecache.py", line 14, in getline
lines = getlines(filename, module_globals)
File "/usr/lib/python2.5/linecache.py", line 40, in getlines
return updatecache(filename, module_globals)
File "/usr/lib/python2.5/linecache.py", line 133, in updatecache
lines = fp.readlines()
MemoryError
#
# python -V
Python 2.5.2
-Richard
__________________________________________________________________________________
Find local businesses and services in your area with Yahoo!7 Local.
Get started: http://local.yahoo.com.au
------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general
