makssent commented on issue #36972: URL: https://github.com/apache/shardingsphere/issues/36972#issuecomment-3576028429
There were some debatable moments during testing. I aligned everything with SYSBENCH, but there are no changes in performance — only stabilized results, and now the metrics are identical to SYSBENCH. --- ## SINGLE — 30-second runs (5 runs × 30s) Threads | QPS #1 | QPS #2 | QPS #3 | QPS #4 | QPS #5 | **QPS avg** | **p95 avg** | **Queries total** | **Queries avg** | **disk_reads total** | **disk_reads avg** --------|--------|--------|--------|--------|--------|-------------|--------------|--------------------|------------------|-----------------------|-------------------- 120 | 4264.20 | 5233.57 | 4807.77 | 5169.20 | 4380.47 | **4771.04** | **101.10 ms** | **716 656** | **143 331** | **553 357** | **110 671** 160 | 4431.60 | 5544.27 | 5930.30 | 4358.17 | 4723.37 | **4997.54** | **113.13 ms** | **749 631** | **149 926** | **599 471** | **119 894** 180 | 4433.53 | 5304.10 | 5850.93 | 4618.50 | 4277.77 | **4896.97** | **153.27 ms** | **734 545** | **146 909** | **587 842** | **117 568** 200 | 3818.73 | 5089.50 | 6021.27 | 4561.00 | 4324.87 | **4763.07** | **169.74 ms** | **714 461** | **142 892** | **570 722** | **114 144** --- ## SINGLE — 60-second runs (5 runs × 60s) Threads | QPS #1 | QPS #2 | QPS #3 | QPS #4 | QPS #5 | **QPS avg** | **p95 avg** | **Queries total** | **Queries avg** | **disk_reads total** | **disk_reads avg** --------|--------|--------|--------|--------|--------|-------------|--------------|--------------------|------------------|-----------------------|-------------------- 120 | 4913.78 | 5295.62 | 5192.07 | 5477.22 | 4185.83 | **5012.90** | **105.33 ms** | **1 503 871** | **300 774** | **1 203 148** | **240 630** 160 | 5194.27 | 5655.33 | 5015.72 | 5449.72 | 3989.92 | **5060.99** | **132.07 ms** | **1 518 297** | **303 659** | **1 213 650** | **242 730** 180 | 5421.23 | 5408.20 | 4959.35 | 5517.52 | 5052.55 | **5271.77** | **158.64 ms** | **1 581 531** | **316 306** | **1 265 990** | **253 198** 200 | 5391.20 | 5470.05 | 5539.00 | 4800.17 | 5003.93 | **5240.87** | **168.57 ms** | **1 572 261** | **314 452** | **1 257 970** | **251 594** --- ## SINGLE — 120-second runs (5 runs × 120s) Threads | QPS #1 | QPS #2 | QPS #3 | QPS #4 | QPS #5 | **QPS avg** | **p95 avg** | **Queries total** | **Queries avg** | **disk_reads total** | **disk_reads avg** --------|--------|--------|--------|--------|--------|-------------|--------------|--------------------|------------------|-----------------------|-------------------- 120 | 4980.14 | 2970.04 | 4114.28 | 4007.80 | 2702.25 | **3754.10** | **130.99 ms** | 2 252 942 | 450 588 | 1 703 743 | 340 749 160 | 5363.02 | 2967.93 | 4284.31 | 4796.78 | 3756.18 | **4233.64** | **176.19 ms** | 2 440 185 | 488 037 | 1 833 697 | 366 739 180 | 4577.58 | 4064.78 | 3947.65 | 3787.37 | 3422.74 | **3960.82** | **176.97 ms** | 2 375 014 | 475 003 | 1 891 278 | 378 255 200 | 3232.85 | 4322.37 | 4189.58 | 2194.95 | 3346.31 | **3457.21** | **262.67 ms** | 1 984 283 | 396 857 | 1 508 043 | 301 609 --- ## CLUSTER — 30-second runs (5 runs × 30s) Threads | QPS #1 | QPS #2 | QPS #3 | QPS #4 | QPS #5 | **QPS avg** | **p95 avg** | **Queries total** | **Queries avg** | **disk_reads total** | **disk_reads avg** --------|--------|--------|--------|--------|--------|-------------|--------------|--------------------|------------------|-----------------------|-------------------- 120 | 7092.43 | 7224.40 | 8369.73 | 5454.40 | 6440.63 | **6916.32** | **30.13 ms** | **1 037 448** | **207 490** | **0** | **0** 160 | 8500.50 | 8369.83 | 9625.53 | 6934.03 | 6745.33 | **8035.04** | **36.75 ms** | **1 205 257** | **241 051** | **3** | **1** 180 | 9088.23 | 9441.10 | 8447.07 | 8289.43 | 7180.90 | **8489.35** | **40.33 ms** | **1 273 402** | **254 680** | **1** | **0** 200 | 9145.90 | 9067.00 | 8657.03 | 7505.47 | 8448.00 | **8564.68** | **45.46 ms** | **1 284 702** | **256 940** | **6** | **1** --- ## CLUSTER — 60-second runs (5 runs × 60s) Threads | QPS #1 | QPS #2 | QPS #3 | QPS #4 | QPS #5 | **QPS avg** | **p95 avg** | **Queries total** | **Queries avg** | **disk_reads total** | **disk_reads avg** --------|--------|--------|--------|--------|--------|-------------|--------------|--------------------|------------------|-----------------------|-------------------- 120 | 6038.62 | 7267.73 | 7172.95 | 8583.25 | 6620.23 | **7136.16** | **32.73 ms** | **2 205 867** | **441 173** | **1** | **0** 160 | 6727.03 | 9195.58 | 7880.45 | 7766.42 | 6679.37 | **7649.37** | **37.13 ms** | **2 900 701** | **580 140** | **0** | **0** 180 | 7305.70 | 10950.95 | 8430.73 | 5855.27 | 7275.10 | **7963.15** | **46.17 ms** | **2 857 302** | **571 460** | **0** | **0** 200 | 7070.50 | 9946.05 | 7558.12 | 6070.97 | 6430.62 | **7415.25** | **57.16 ms** | **2 588 363** | **517 672** | **1** | **0** --- ## CLUSTER — 120-second runs (5 runs × 120s) Threads | QPS #1 | QPS #2 | QPS #3 | QPS #4 | QPS #5 | **QPS avg** | **p95 avg** | **Queries total** | **Queries avg** | **disk_reads total** | **disk_reads avg** --------|--------|--------|--------|--------|--------|-------------|--------------|--------------------|------------------|-----------------------|-------------------- 120 | 2892.16 | 3631.78 | 6038.62 | 7267.73 | 7172.95 | **5390.65** | **43.94 ms** | **2 127 485** | **425 497** | **1** | **0** 160 | 4513.17 | 3910.93 | 6727.03 | 9195.58 | 7880.45 | **6445.03** | **41.70 ms** | **2 533 239** | **506 648** | **0** | **0** 180 | 3926.22 | 5106.11 | 7305.70 | 10950.95 | 8430.73 | **7151.54** | **65.75 ms** | **3 041 546** | **608 309** | **0** | **0** 200 | 4912.89 | 4621.41 | 7070.50 | 9946.05 | 7558.12 | **6821.39** | **70.57 ms** | **3 057 625** | **611 525** | **1** | **0** --- ## comparison — 30s / 60s / 120s ### 30 seconds Threads | **QPS Cluster** | **QPS Single** | **p95 Cluster** | **p95 Single** | **disk_reads Cluster** | **disk_reads Single** | **QPS gain** --------|------------------|----------------|------------------|----------------|-------------------------|------------------------|-------------- 120 | **6916.32** | 4771.04 | 30.13 ms | 101.10 ms | 0 | 553357 | **+45.0%** 160 | **8035.04** | 4997.54 | 36.75 ms | 113.13 ms | 1 | 599471 | **+60.7%** 180 | **8489.35** | 4896.97 | 40.33 ms | 153.27 ms | 0 | 587842 | **+73.4%** 200 | **8564.68** | 4763.07 | 45.46 ms | 169.74 ms | 1 | 570722 | **+79.8%** ### 60 seconds Threads | **QPS Cluster** | **QPS Single** | **p95 Cluster** | **p95 Single** | **disk_reads Cluster** | **disk_reads Single** | **QPS gain** --------|------------------|----------------|------------------|----------------|-------------------------|------------------------|-------------- 120 | **7136.16** | 5012.90 | 32.73 ms | 105.33 ms | 0 | 1 203 148 | **+42.3%** 160 | **7649.37** | 5060.99 | 37.13 ms | 132.07 ms | 0 | 1 213 650 | **+51.1%** 180 | **7963.15** | 5271.77 | 46.17 ms | 158.64 ms | 0 | 1 265 990 | **+51.0%** 200 | **7415.25** | 5240.87 | 57.16 ms | 168.57 ms | 0 | 1 257 970 | **+41.5%** ### 120 seconds Threads | **QPS Cluster** | **QPS Single** | **p95 Cluster** | **p95 Single** | **disk_reads Cluster** | **disk_reads Single** | **QPS gain** --------|------------------|----------------|------------------|----------------|-------------------------|------------------------|-------------- 120 | **5390.65** | 3754.10 | 43.94 ms | 130.99 ms | 0 | 1 703 743 | **+43.6%** 160 | **6445.03** | 4233.64 | 41.70 ms | 176.19 ms | 0 | 1 833 697 | **+52.2%** 180 | **7151.54** | 3960.82 | 65.75 ms | 176.97 ms | 0 | 1 891 278 | **+80.5%** 200 | **6821.39** | 3457.21 | 70.57 ms | 262.67 ms | 0 | 1 508 043 | **+97.3%** -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
