thanks so far! so - here are some numbers:
i booted into linux, and streaming writes (1M blocksize) are 6-8MB/s, streaming READS are >100MB/s !!!! (tested with filesize >>ramsize) with Solaris, i`m getting similar value for WRITES, but READS are painfully slow. >1) Have you disabled atime on the dataset(s)? (zfs set atime=off pool) is that really relevant here with huge, single files ? i don`t care about small file performance as this will be a backup-box where i rsync (--inplace) large datafiles to. >2) How much physical memory do you have? 4gb 3) How do successive runs look? that does not make a difference at all 4) Did you enable compression? nope >I would recommend also looking not just at 'iostat' but also 'fsstat' to get a >better idea of what the IO load is like on an op basis. with fsstat, i don`t see anything what iostat doesn`t tell: when reading, "read ops" and "read bytes" look as weird as with iostat - nothing in the other columes, as i`m doing single, largefile operations. >And if you must, use /dev/null not /dev/zero.) err, sure :) so - here`s some data for WRITES: bash-3.2# ptime dd if=/dev/urandom of=/zfs/TESTFILE bs=1024k count=512 512+0 Datensätze in 512+0 Datensätze aus real 1:56.271140184 user 0.003242303 sys 18.139012578 r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device bash-3.2# iostat -zxnd 1 |egrep -v "extended|device" 2.7 1.1 266.2 11.8 5.5 0.1 1463.7 14.4 18 2 c0t0d0 14.3 7.7 2770.3 1409.1 4.7 0.4 214.9 16.0 18 17 c0t1d0 4.0 0.0 140.0 0.0 0.0 0.0 0.0 7.7 0 2 c0t1d0 0.0 14.0 0.0 1555.4 1.9 0.7 136.6 50.5 21 23 c0t1d0 0.0 64.0 0.0 8192.1 29.9 3.0 466.6 46.7 100 100 c0t1d0 0.0 60.0 0.0 7680.2 32.0 3.0 533.2 49.8 100 100 c0t1d0 0.0 66.0 0.0 8447.8 30.7 3.0 464.8 45.3 100 100 c0t1d0 0.0 56.0 0.0 3008.5 5.4 1.8 96.3 31.3 78 66 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 25.0 0.0 2968.4 10.3 1.1 414.0 44.0 100 38 c0t1d0 0.0 67.0 0.0 8575.9 31.9 3.0 476.5 44.6 100 100 c0t1d0 0.0 60.0 0.0 7680.1 32.0 3.0 533.2 49.8 100 100 c0t1d0 0.0 67.0 0.0 8575.8 26.4 3.0 393.5 44.6 100 100 c0t1d0 0.0 41.0 0.0 1094.5 4.8 1.0 117.8 24.8 86 38 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 46.0 0.0 5653.7 18.0 2.0 392.1 43.1 100 67 c0t1d0 0.0 65.0 0.0 8320.0 32.0 3.0 492.2 46.0 100 100 c0t1d0 0.0 64.0 0.0 8192.8 32.0 3.0 499.9 46.7 100 100 c0t1d0 0.0 82.0 0.0 6469.0 15.4 2.9 187.9 35.2 85 100 c0t1d0 0.0 2.0 0.0 256.0 7.0 0.0 3491.8 4.0 100 1 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 3.0 0.0 150.5 7.0 0.1 2319.5 33.8 100 4 c0t1d0 0.0 65.0 0.0 8319.8 27.0 3.0 415.1 46.0 100 100 c0t1d0 0.0 65.0 0.0 8320.2 32.0 3.0 492.2 46.0 100 100 c0t1d0 0.0 62.0 0.0 7936.5 32.0 3.0 516.0 48.2 100 100 c0t1d0 0.0 76.0 0.0 6335.9 15.9 2.9 209.4 38.6 86 100 c0t1d0 0.0 8.0 0.0 387.9 6.4 0.3 804.3 32.8 96 9 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 65.0 0.0 8084.8 25.2 2.8 387.9 43.8 100 96 c0t1d0 0.0 67.0 0.0 8576.4 32.0 3.0 477.5 44.6 100 100 c0t1d0 0.0 66.0 0.0 8448.0 30.3 3.0 458.5 45.3 100 100 c0t1d0 0.0 54.0 0.0 2754.9 5.4 1.6 100.1 29.7 84 58 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 30.0 0.0 3607.9 12.7 1.4 422.0 46.8 100 48 c0t1d0 0.0 65.0 0.0 8320.4 32.3 2.6 497.5 40.6 100 89 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 9.0 0.0 1151.7 34.5 0.5 3837.8 51.7 100 16 c0t1d0 0.0 60.0 0.0 7680.6 32.0 3.0 533.0 49.8 100 100 c0t1d0 0.0 67.0 0.0 4422.5 9.3 2.2 138.5 32.7 86 77 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 18.0 0.0 2068.1 8.7 0.8 483.8 46.3 100 29 c0t1d0 0.0 64.0 0.0 8191.9 31.2 3.0 487.5 46.8 100 100 c0t1d0 0.0 70.0 0.0 8960.4 31.8 3.0 454.9 42.8 100 100 c0t1d0 0.0 84.0 0.0 6489.3 10.3 2.9 122.8 34.7 86 100 c0t1d0 0.0 66.0 0.0 8448.3 31.6 3.0 478.5 45.4 100 100 c0t1d0 0.0 67.0 0.0 8576.5 29.4 3.0 438.9 44.8 100 100 c0t1d0 0.0 77.0 0.0 5461.8 8.3 2.9 108.1 38.0 74 100 c0t1d0 0.0 65.0 0.0 8320.0 32.0 3.0 492.2 46.1 100 100 c0t1d0 0.0 82.0 0.0 6718.7 16.9 2.9 206.0 35.4 89 100 c0t1d0 0.0 5.0 0.0 385.0 6.5 0.2 1295.4 48.4 96 9 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 62.0 0.0 7826.4 24.4 2.9 394.1 46.3 100 97 c0t1d0 0.0 67.0 0.0 8576.2 26.4 3.0 394.2 44.8 100 100 c0t1d0 0.0 42.0 0.0 1344.5 4.6 1.1 110.3 27.0 84 41 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 39.0 0.0 4885.0 16.0 1.8 411.4 47.2 100 64 c0t1d0 0.0 66.0 0.0 8447.9 32.0 3.0 484.8 45.4 100 100 c0t1d0 0.0 66.0 0.0 8449.0 28.0 3.0 424.1 45.4 100 100 c0t1d0 0.0 78.0 0.0 5851.6 11.2 2.9 143.8 36.8 86 100 c0t1d0 0.0 61.0 0.0 7808.3 32.0 3.0 524.6 49.2 100 100 c0t1d0 0.0 64.0 0.0 8192.1 32.0 3.0 500.0 46.9 100 100 c0t1d0 0.0 67.0 0.0 7588.4 21.6 2.9 322.1 43.9 96 100 c0t1d0 0.0 82.0 0.0 7224.0 20.6 3.0 251.1 36.1 94 100 c0t1d0 0.0 68.0 0.0 8704.5 32.0 3.0 470.5 44.1 100 100 c0t1d0 0.0 74.0 0.0 8225.5 22.1 3.0 298.2 40.3 96 100 c0t1d0 0.0 77.0 0.0 6839.9 20.1 3.0 261.7 38.4 95 100 c0t1d0 0.0 68.0 0.0 8706.6 32.0 3.0 470.4 44.1 100 100 c0t1d0 0.0 82.0 0.0 6342.9 14.8 2.9 180.3 35.9 86 100 c0t1d0 0.0 3.0 0.0 384.0 6.9 0.0 2304.2 14.6 100 2 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 6.0 0.0 533.5 7.0 0.2 1168.2 39.5 100 9 c0t1d0 0.0 66.0 0.0 8448.1 28.5 3.0 431.4 45.4 100 100 c0t1d0 0.0 60.0 0.0 7680.9 32.0 3.0 533.3 50.0 100 100 c0t1d0 0.0 68.0 0.0 8703.3 24.9 3.0 366.1 44.1 100 100 c0t1d0 0.0 37.0 0.0 707.4 5.3 0.8 142.0 21.0 87 28 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 49.0 0.0 6042.5 20.0 2.3 408.2 46.5 100 77 c0t1d0 0.0 63.0 0.0 8064.1 32.0 3.0 507.9 47.6 100 100 c0t1d0 0.0 66.0 0.0 8447.4 32.0 3.0 484.9 45.4 100 100 c0t1d0 0.0 82.0 0.0 7109.2 18.3 2.9 223.6 35.8 91 100 c0t1d0 0.0 66.0 0.0 7581.2 22.9 3.0 347.2 44.9 98 100 c0t1d0 0.0 63.0 0.0 8065.0 32.0 3.0 507.9 47.6 100 100 c0t1d0 0.0 66.0 0.0 8448.2 32.0 3.0 484.8 45.4 100 100 c0t1d0 0.0 59.0 0.0 7552.0 27.7 3.0 469.1 50.8 100 100 c0t1d0 0.0 84.0 0.0 6500.2 13.5 2.9 161.0 34.4 89 100 c0t1d0 0.0 68.0 0.0 8704.3 32.0 3.0 470.6 44.1 100 100 c0t1d0 0.0 69.0 0.0 8832.1 32.0 3.0 463.7 43.5 100 100 c0t1d0 0.0 84.0 0.0 6615.9 15.2 2.9 180.4 34.5 91 100 c0t1d0 0.0 66.0 0.0 8329.2 26.7 3.0 404.5 45.4 100 100 c0t1d0 0.0 66.0 0.0 8448.1 32.0 3.0 484.8 45.4 100 100 c0t1d0 0.0 75.0 0.0 8482.9 21.5 3.0 287.1 39.4 94 100 c0t1d0 0.0 81.0 0.0 5578.6 15.7 2.9 194.0 36.3 94 100 c0t1d0 0.0 68.0 0.0 8704.7 32.0 3.0 470.5 44.1 100 100 c0t1d0 0.0 72.0 0.0 9216.0 32.0 3.0 444.4 41.7 100 100 c0t1d0 0.0 76.0 0.0 5829.5 14.0 2.8 183.7 36.4 81 100 c0t1d0 0.0 2.0 0.0 1.0 0.0 0.0 0.0 0.2 0 0 c0t1d0 0.0 3.0 0.0 383.9 5.2 0.2 1746.3 78.0 78 7 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 7.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 57.0 0.0 3025.8 4.7 1.7 81.8 29.0 70 60 c0t1d0 umount /zfs (to flush all buffer caches), remount and here`s the data for READS *sigh* : bash-3.2# ptime dd if=/zfs/TESTFILE of=/dev/null bs=1024k 512+0 Datensätze in 512+0 Datensätze aus real 4:04.464142355 user 0.002964864 sys 0.999094707 iostat -zxnd 1 |egrep -v "extended|device" r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 80.0 0.0 10238.1 0.0 26.4 0.4 329.8 5.2 80 14 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 30.0 0.0 3839.3 0.0 34.9 0.1 1162.2 4.3 100 4 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 26.0 0.0 3327.5 0.0 34.8 0.2 1340.2 5.8 100 6 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 58.0 0.0 7422.8 0.0 34.7 0.3 598.4 4.7 100 10 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 25.0 0.0 3200.0 0.0 34.9 0.1 1394.9 4.7 100 4 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 7.0 0.0 895.9 0.0 35.0 0.0 4996.7 3.4 100 1 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 69.0 0.0 8830.5 0.0 34.6 0.4 501.6 5.3 100 13 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 37.0 0.0 4735.3 0.0 34.8 0.2 940.2 5.5 100 7 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 7.0 0.0 895.9 0.0 35.0 0.0 4995.3 5.0 100 2 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 27.0 0.0 3455.4 0.0 34.9 0.1 1291.4 4.7 100 4 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 13.0 0.0 1663.7 0.0 34.9 0.1 2685.2 7.2 100 3 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 46.0 0.0 5887.1 0.0 34.8 0.2 756.3 4.3 100 7 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 31.0 0.0 3967.2 0.0 34.8 0.2 1123.9 5.0 100 6 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 10.0 0.0 1279.8 0.0 34.9 0.1 3492.0 8.1 100 3 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 29.0 0.0 3711.6 0.0 34.9 0.1 1201.9 4.7 100 5 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 55.0 0.0 7037.2 0.0 34.7 0.3 631.1 4.8 100 9 c0t1d0 86.0 0.0 10888.5 0.0 32.4 0.4 377.2 4.8 99 15 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 83.0 0.0 10559.2 0.0 19.2 0.4 231.6 4.6 99 13 c0t1d0 0.0 0.0 0.0 0.0 16.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 16.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 16.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 16.0 0.0 0.0 0.0 100 0 c0t1d0 9.0 0.0 1151.8 0.0 22.5 0.0 2500.0 5.4 100 2 c0t1d0 0.0 0.0 0.0 0.0 25.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 25.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 25.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 25.0 0.0 0.0 0.0 100 0 c0t1d0 35.0 0.0 4479.3 0.0 32.0 0.2 914.7 4.4 100 5 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 14.0 0.0 1791.6 0.0 34.9 0.1 2494.0 6.0 100 3 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 46.0 0.0 5887.1 0.0 34.7 0.3 754.9 5.8 100 9 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 16.0 0.0 2047.8 0.0 34.9 0.1 2182.5 4.9 100 3 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 30.0 0.0 3839.5 0.0 34.9 0.1 1162.2 4.2 100 4 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 30.0 0.0 3839.3 0.0 34.8 0.1 1161.8 4.7 100 5 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 39.0 0.0 4991.4 0.0 34.8 0.2 892.3 4.9 100 7 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 21.0 0.0 2687.5 0.0 34.9 0.1 1660.7 5.9 100 5 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 24.0 0.0 3072.1 0.0 34.9 0.1 1452.5 5.4 100 5 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 83.0 0.0 10622.6 0.0 34.6 0.4 416.5 4.7 100 14 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 17.0 0.0 2175.6 0.0 34.9 0.1 2050.7 8.2 100 5 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 119.8 0.0 15336.3 0.0 34.4 0.5 287.4 4.4 100 18 c0t1d0 115.2 0.0 14739.6 0.0 34.4 0.6 298.6 4.9 100 20 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 77.0 0.0 9854.3 0.0 34.6 0.4 449.6 4.6 100 13 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 21.0 0.0 2687.7 0.0 34.9 0.1 1661.7 4.8 100 4 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 42.0 0.0 5375.8 0.0 34.7 0.2 827.3 5.7 100 8 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 27.0 0.0 3455.3 0.0 34.8 0.2 1289.3 6.9 100 6 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 13.0 0.0 1663.9 0.0 34.9 0.1 2685.4 6.6 100 3 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 32.0 0.0 4095.2 0.0 34.8 0.1 1089.0 4.5 100 5 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 19.0 0.0 2431.8 0.0 34.9 0.1 1836.0 5.8 100 4 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 155.0 0.0 19838.1 0.0 34.2 0.7 220.7 4.8 100 26 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 44.0 0.0 5631.8 0.0 34.8 0.2 790.7 4.4 100 7 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 83.0 0.0 10619.2 0.0 34.5 0.4 415.4 5.3 100 15 c0t1d0 39.0 0.0 4871.5 0.0 13.8 0.2 352.9 4.9 100 7 c0t1d0 0.0 0.0 0.0 0.0 14.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 14.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 14.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 14.0 0.0 0.0 0.0 100 0 c0t1d0 7.0 0.0 896.0 0.0 20.4 0.1 2908.5 8.7 100 3 c0t1d0 0.0 0.0 0.0 0.0 21.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 21.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 21.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 21.0 0.0 0.0 0.0 100 0 c0t1d0 36.0 0.0 4607.9 0.0 33.3 0.2 926.3 5.3 100 7 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 33.0 0.0 4223.6 0.0 34.9 0.1 1056.9 3.4 100 4 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 13.0 0.0 1663.8 0.0 34.9 0.1 2687.6 4.6 100 2 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 42.0 0.0 5375.2 0.0 34.8 0.2 828.7 4.3 100 6 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 16.0 0.0 2047.6 0.0 34.9 0.1 2182.8 4.6 100 3 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 14.0 0.0 1791.7 0.0 34.9 0.1 2491.9 8.1 100 4 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 51.0 0.0 6527.8 0.0 34.8 0.2 681.8 4.0 100 7 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 0.0 0.0 0.0 0.0 35.0 0.0 0.0 0.0 100 0 c0t1d0 284.9 0.0 36473.6 0.0 33.1 1.9 116.1 6.6 100 64 c0t1d0 261.0 0.0 33409.0 0.0 15.8 1.6 60.4 6.0 52 53 c0t1d0 so, now sort of a "proof" that this is most likely not a hdd/raid or device-driver (LSI MegaRaid) issue (?), because when directly reading from the blockdevice , performance looks quite good (did a reboot before to have clean caches): bash-3.2# ptime dd if=/dev/rdsk/c0t1d0p0 of=/dev/null bs=1024k count=512 512+0 Datensätze in 512+0 Datensätze aus real 5.962893382 user 0.003204880 sys 0.082188668 iostat -zxnd 1 |egrep -v "extended|device" r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 2.0 4.0 64.5 8.0 0.0 0.0 0.0 8.1 0 5 c0t0d0 69.0 2.0 66548.4 0.0 0.0 0.9 0.1 12.5 1 89 c0t1d0 84.0 0.0 86013.3 0.0 0.0 1.0 0.1 11.6 1 97 c0t1d0 93.0 0.0 95240.9 0.0 0.0 1.0 0.1 10.4 1 97 c0t1d0 92.0 0.0 94204.1 0.0 0.0 1.0 0.1 10.5 1 97 c0t1d0 88.0 0.0 90116.8 0.0 0.0 1.0 0.1 11.0 1 97 c0t1d0 87.0 0.0 89079.5 0.0 0.0 1.0 0.1 11.2 1 97 c0t1d0 3.0 0.0 3072.2 0.0 0.0 0.0 0.1 6.3 0 2 c0t1d0 -- This message posted from opensolaris.org _______________________________________________ perf-discuss mailing list perf-discuss@opensolaris.org