On 8/13/07, mabshoff <[EMAIL PROTECTED]> wrote:
> I tried rsyncing htdocs to my mirror today and the file system on
> sage.math is very slow (hours+ to rsync a 120MB file and still waiting
> on that one). One oddity I came across is this one process:
>
> rlmill 8598 1.5 0.0 3852 512 pts/16 DN+ 09:53 4:09 rm -
> rf tmp
>
> The DN+ indicates "Uninterruptible sleep (usually IO)" and "low
> priority". According to top the load on sage.math is around 25, but I
> don't see any process doing a lot of IO. The number of page faults at
> the moment is miniscule. The is also one zombie at the moment. Any
> ideas?
Robert Miller was cleaning up his home directories (we ran out
of disk space yesterday) and ...
8598 pts/16 DN+ 7:47 rm -rf tmp
The problem is that the directory tmp contains almost 5 million files:
sage:/home/rlmill/tmp# ls -1 > a
sage:/home/rlmill/tmp# wc -l a
4754843 a
(Robert -- Why do you have so many tmp files? Maybe you should
be using a database? Filesystems like ext3 aren't good at dealing
with 5 million files in a directory...)
Anyway, I remounted the filesystem and somehow managed to
kill the above job. I then wrote a Python script that is now sitting
there deleting those 5 million files one-by-one with a pause between
each deletion, so sage.math should feel snappy again:
12062 pts/1 S 0:01 python ./del.py
-- William
--~--~---------~--~----~------------~-------~--~----~
To post to this group, send email to sage-devel@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at http://groups.google.com/group/sage-devel
URLs: http://sage.scipy.org/sage/ and http://modular.math.washington.edu/sage/
-~----------~----~----~----~------~----~------~--~---
