Hello,
ZFS is behaving strange on a OSOL laptop, your thoughts are welcome.
I am running OSOL on my laptop, currently b124 and i found that the
performance of ZFS is not optimal in all situations. If i check the
how much space the package cache for pkg(1) uses, it takes a bit
longer on this host than on comparable machine to which i transferred
all the data.
u...@host:/var/pkg$ time du -hs download
6.4G download
real 87m5.112s
user 0m6.820s
sys 1m46.111s
My guess would be that this is due to fragmentation during some time
when the filesystem might have been close to full, but it is still
pretty terrible numbers even with 0.5M files in the structure. And
while this is very bad I would at least expect the ARC to cache data
and make a second run go faster:
u...@host:/var/pkg$ time du -hs download
6.4G download
real 94m14.688s
user 0m6.708s
sys 1m27.105s
Two runs on the machine to which i have transferred the directory
structure:
$ time du -hs download
6.4G download
real 2m59.60s
user 0m3.83s
sys 0m18.87s
This goes a bit faster after the initial run also:
$ time du -hs download
6.4G download
real 0m15.40s
user 0m3.40s
sys 0m11.43s
The disk are of course very busy during the first runs on both
machines, but on the slow machine it has to do all the work again
while the disk in the fast machine gets to rest on the second run.
Slow system (OSOL b124, T61 Intel c2d laptop root pool on 2.5" disk):
memstat pre first run:
Kernel 162685 635 16%
ZFS File Data 81284 317 8%
Anon 57323 223 6%
Exec and libs 3248 12 0%
Page cache 14924 58 1%
Free (cachelist) 7881 30 1%
Free (freelist) 700315 2735 68%
Total 1027660 4014
Physical 1027659 4014
memstat post first run:
Page Summary Pages MB %Tot
------------ ---------------- ---------------- ----
Kernel 461153 1801 45%
ZFS File Data 83598 326 8%
Anon 58389 228 6%
Exec and libs 3215 12 0%
Page cache 14958 58 1%
Free (cachelist) 6849 26 1%
Free (freelist) 399498 1560 39%
Total 1027660 4014
Physical 1027659 4014
arcstat first run:
Time read miss miss% dmis dm% pmis pm% mmis mm%
arcsz c
21:02:31 279 19 7 11 4 7 30 11 10 439M
3G
21:12:31 190 60 31 52 28 8 97 60 32 734M
3G
21:22:31 225 58 25 57 25 0 94 58 25 873M
3G
21:32:31 206 51 24 51 24 0 24 50 24 985M
3G
21:42:31 175 43 24 43 24 0 29 42 24 1G
3G
21:52:31 162 48 29 48 29 0 54 48 29 1G
3G
22:02:31 159 55 34 54 34 0 90 55 34 1G
3G
22:12:31 164 41 25 41 24 0 61 41 25 1G
3G
22:22:31 161 40 24 40 24 0 68 40 24 1G
3G
arcstat second run:
Time read miss miss% dmis dm% pmis pm% mmis mm%
arcsz c
22:35:52 1K 447 24 429 23 17 47 436 26 1G
3G
22:45:52 163 40 24 40 24 0 75 40 24 1G
3G
22:55:52 161 40 25 40 24 0 86 40 25 1G
3G
23:05:52 159 40 25 39 25 0 71 40 25 1G
3G
23:15:52 158 40 25 40 25 0 86 40 25 1G
3G
23:25:52 158 40 25 40 25 0 100 40 25 1G
3G
23:35:52 157 40 25 40 25 0 100 40 25 1G
3G
23:45:52 158 40 25 40 25 0 100 40 25 1G
3G
23:55:52 160 40 25 40 25 0 100 40 25 1G
3G
00:05:52 156 40 25 40 25 0 100 40 25 1G
3G
Fast system (OSOL b124, AMD Athlon X2 server, tested on root pool on
2.5" SATA disk)
Memstat pre run:
Page Summary Pages MB %Tot
------------ ---------------- ---------------- ----
Kernel 160338 626 8%
ZFS File Data 44875 175 2%
Anon 24388 95 1%
Exec and libs 1295 5 0%
Page cache 6490 25 0%
Free (cachelist) 4786 18 0%
Free (freelist) 1753978 6851 88%
Balloon 0 0 0%
Total 1996150 7797
Memstat post run:
Page Summary Pages MB %Tot
------------ ---------------- ---------------- ----
Kernel 516130 2016 26%
ZFS File Data 44942 175 2%
Anon 24414 95 1%
Exec and libs 1293 5 0%
Page cache 6490 25 0%
Free (cachelist) 3557 13 0%
Free (freelist) 1399324 5466 70%
Balloon 0 0 0%
Total 1996150 7797
arcstat first run:
Time read miss miss% dmis dm% pmis pm% mmis mm%
arcsz c
00:23:49 14K 821 5 550 4 270 21 556 8 268M
7G
00:23:59 3K 828 22 646 21 181 26 827 22 322M
7G
00:24:09 5K 1K 23 1K 23 98 21 1K 23 375M
7G
00:24:19 6K 1K 18 1K 20 97 7 1K 18 429M
7G
00:24:29 8K 1K 16 1K 19 80 4 1K 16 487M
7G
00:24:39 6K 1K 22 1K 23 36 5 1K 22 542M
7G
00:24:49 5K 1K 23 1K 23 102 20 1K 23 602M
7G
00:24:59 9K 1K 14 1K 17 112 4 1K 14 667M
7G
00:25:09 9K 1K 15 1K 18 69 3 1K 15 722M
7G
00:25:19 5K 1K 21 1K 22 58 9 1K 21 767M
7G
00:25:29 6K 1K 22 1K 23 48 11 1K 22 822M
7G
arcstat second run:
Time read miss miss% dmis dm% pmis pm% mmis mm%
arcsz c
00:27:59 138K 24K 17 23K 19 1K 8 24K 18 1G
7G
00:28:09 47K 58 0 0 0 58 10 58 0 1G
7G
00:28:19 46K 46 0 0 0 46 2 46 0 1G
7G
Regards
Henrik
http://sparcv9.blogspot.com
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
