William Stein wrote: Hello,
> > On 8/13/07, mabshoff <[EMAIL PROTECTED]> > wrote: >> I tried rsyncing htdocs to my mirror today and the file system on >> sage.math is very slow (hours+ to rsync a 120MB file and still waiting >> on that one). One oddity I came across is this one process: >> >> rlmill 8598 1.5 0.0 3852 512 pts/16 DN+ 09:53 4:09 rm - >> rf tmp >> >> The DN+ indicates "Uninterruptible sleep (usually IO)" and "low >> priority". According to top the load on sage.math is around 25, but I >> don't see any process doing a lot of IO. The number of page faults at >> the moment is miniscule. The is also one zombie at the moment. Any >> ideas? > > Robert Miller was cleaning up his home directories (we ran out > of disk space yesterday) and ... > 8598 pts/16 DN+ 7:47 rm -rf tmp > The problem is that the directory tmp contains almost 5 million files: > lol, you just made my day :) - I have seen much in my 12+ years as sysadmin, but I had never seen 5 Million files in one directory. > sage:/home/rlmill/tmp# ls -1 > a > sage:/home/rlmill/tmp# wc -l a > 4754843 a > > (Robert -- Why do you have so many tmp files? Maybe you should > be using a database? Filesystems like ext3 aren't good at dealing > with 5 million files in a directory...) > Especially since the lookup of directory entries is not hashed. That is coming with ext4. > Anyway, I remounted the filesystem and somehow managed to > kill the above job. I then wrote a Python script that is now sitting > there deleting those 5 million files one-by-one with a pause between > each deletion, so sage.math should feel snappy again: > 12062 pts/1 S 0:01 python ./del.py > Mmmmh, so the python script will be done in 5 Million seconds? That will take roughly 2 months time. Oh well, maybe it is time for quoatas ;) > -- William > Cheers, Michael --~--~---------~--~----~------------~-------~--~----~ To post to this group, send email to sage-devel@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/sage-devel URLs: http://sage.scipy.org/sage/ and http://modular.math.washington.edu/sage/ -~----------~----~----~----~------~----~------~--~---
