[ re-adding bug-coreutils]

On Wed, 26 Sep 2007, Ken Naim wrote:

I created a test case similar to my nightly job which removes 130 or so 5gb files. The apps* files are identical to files I remove nightly and are 4.3 gb in size, the ctx files are 20mb, and the single letter files are 0 byte files. Based on the strace there is a correlation between file size and unlink time. 4.3gb takes 10 seconds, 20mb take less than .1 seconds and 0 byte files take no time.

unlink("apps_ts_tx_data_2.270.632954231") = 0 <10.418224>
unlink("apps_ts_tx_data_2.271.632954231") = 0 <10.691083>
unlink("ctxd.367.632955010")            = 0 <0.051140>
unlink("ctxd.367.632955011")            = 0 <0.078666>
unlink("d")                             = 0 <0.000059>
unlink("e")                             = 0 <0.000050>

As I thought, rm is limited by the speed of the underlying I/O. I'd suggest some performance tuning for your filesystem and SAN, but that's very dependent on your current setup. unlink shouldn't cause much I/O compared to other read/write operations, so I'm surprised you only noticed issues with rm.


Cheers,
Phil




_______________________________________________
Bug-coreutils mailing list
Bug-coreutils@gnu.org
http://lists.gnu.org/mailman/listinfo/bug-coreutils

Reply via email to