On Sat, 3 Oct 2009, Jeff Haferman wrote:

When I go into directory "0", it takes about a minute for an "ls -1 |
grep wc" to return (it has about 12,000 files).  Directory "1" takes
between 5-10 minutes for the same command to return (it has about 50,000
files).

This seems kind of slow. In the directory with a million files that I keep around for testing this is the time for the first access:

% time \ls -1 | grep wc
\ls -1  4.70s user 1.20s system 32% cpu 17.994 total
grep wc  0.11s user 0.02s system 0% cpu 17.862 total

and for the second access:

% time \ls -1 | grep wc
\ls -1  4.66s user 1.17s system 69% cpu 8.366 total
grep wc  0.11s user 0.02s system 1% cpu 8.234 total

However, my directory was created as quickly as possible rather than incrementally over a long period of time so it lacks the longer/increased disks seeks caused by fragmentation and block allocations.

That said, directories with 50K files list quite quickly here.

I did an rsync of this directory structure to another filesystem
[lustre-based, FWIW] and it took about 24 hours to complete.  We have

Rsync is very slow in such situations.

What version of Solaris are you using? The Solaris version (including patch version if using Solaris 10) can make a big difference.

Bob
--
Bob Friesenhahn
bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/
GraphicsMagick Maintainer,    http://www.GraphicsMagick.org/
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Reply via email to