On Sun, 16 Mar 2008, Richard Elling wrote: > > But where is the bottleneck? iostat will show bottlenecks in the > physical disks and channels. vmstat or mpstat will show the > bottlenecks in cpus. To see if the app is the bottleneck will > require some analysis of the app itself. Is it spending its time > blocked on I/O?
The application is spending almost all the time blocked on I/O. I see that the number of device writes per second seems pretty high. The application is doing I/O in 128K blocks. How many IOPS does a modern 300GB 15K RPM SAS drive typically deliver? Of course the IOPS capacity depends on if the access is random or sequential. At the application level, the access is completely sequential but ZFS is likely doing some extra seeks. iostat output (atime=off): extended device statistics device r/s w/s Mr/s Mw/s wait actv svc_t %w %b sd0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 sd1 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0 0 sd2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 sd10 80.4 170.7 10.0 19.9 0.0 9.2 36.5 0 54 sd11 82.1 170.2 10.2 20.0 0.0 13.3 52.9 0 71 sd12 79.3 168.3 9.9 20.0 0.0 13.1 53.1 0 69 sd13 80.6 173.0 10.0 19.9 0.0 9.3 36.7 0 56 sd14 80.9 167.8 10.1 20.0 0.0 13.4 53.8 0 70 sd15 77.7 168.7 9.7 19.9 0.0 9.1 37.1 0 52 sd16 77.3 170.6 9.6 20.0 0.0 13.3 53.7 0 70 sd17 76.4 168.2 9.5 20.0 0.0 9.1 37.2 0 52 sd18 76.7 172.2 9.5 19.9 0.0 13.5 54.2 0 70 sd19 83.8 173.2 10.4 20.0 0.0 13.7 53.4 0 74 sd20 73.3 174.3 9.1 20.0 0.0 9.1 36.9 0 56 sd21 75.3 170.2 9.4 20.0 0.0 13.2 53.9 0 69 nfs1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 % mpstat CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt idl 0 288 1 189 1018 413 815 26 102 88 0 3046 3 3 0 94 1 185 1 180 634 1 830 43 111 74 0 3117 3 2 0 94 2 284 1 183 521 6 617 27 98 67 0 4954 4 3 0 93 3 176 1 239 748 353 555 25 76 62 0 3933 4 3 0 93 Bob ====================================== Bob Friesenhahn [EMAIL PROTECTED], http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss