ayush00git commented on PR #3579:
URL: https://github.com/apache/fory/pull/3579#issuecomment-4276126954
@chaokunyang have a look at the terminal output now, i tried setting the cpu
performance fixed and now it didn't showed any regression
```markdown
fory/benchmarks/rust on main [$✘?] is v0.17.0-alpha.0 via v3.14.3 via
v1.95.0 on (us-east-1) took 18s
❯ cargo bench --bench buffer_write_bench -- --save-baseline main
Finished `bench` profile [optimized] target(s) in 0.06s
Running benches/buffer_write_bench.rs
(target/release/deps/buffer_write_bench-011c6e0ee322c976)
Gnuplot not found, using plotters backend
write_u8/current time: [6.9713 µs 6.9928 µs 7.0194 µs]
thrpt: [142.46 Melem/s 143.00 Melem/s 143.44
Melem/s]
Found 15 outliers among 100 measurements (15.00%)
8 (8.00%) high mild
7 (7.00%) high severe
write_i32/current time: [741.79 ns 743.48 ns 745.28 ns]
thrpt: [1.3418 Gelem/s 1.3450 Gelem/s 1.3481
Gelem/s]
Found 10 outliers among 100 measurements (10.00%)
1 (1.00%) low severe
1 (1.00%) low mild
7 (7.00%) high mild
1 (1.00%) high severe
write_i64/current time: [749.40 ns 751.35 ns 753.40 ns]
thrpt: [1.3273 Gelem/s 1.3309 Gelem/s 1.3344
Gelem/s]
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) low mild
3 (3.00%) high mild
1 (1.00%) high severe
write_f32/current time: [827.00 ns 834.11 ns 841.56 ns]
thrpt: [1.1883 Gelem/s 1.1989 Gelem/s 1.2092
Gelem/s]
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
write_f64/current time: [860.26 ns 866.46 ns 872.89 ns]
thrpt: [1.1456 Gelem/s 1.1541 Gelem/s 1.1624
Gelem/s]
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) high mild
5 (5.00%) high severe
write_varint32_small/current
time: [894.10 ns 898.41 ns 902.69 ns]
thrpt: [1.1078 Gelem/s 1.1131 Gelem/s 1.1184
Gelem/s]
Found 11 outliers among 100 measurements (11.00%)
1 (1.00%) low severe
1 (1.00%) low mild
6 (6.00%) high mild
3 (3.00%) high severe
write_varint32_medium/current
time: [1.4174 µs 1.4189 µs 1.4207 µs]
thrpt: [703.90 Melem/s 704.77 Melem/s 705.54
Melem/s]
Found 11 outliers among 100 measurements (11.00%)
1 (1.00%) low mild
7 (7.00%) high mild
3 (3.00%) high severe
write_varint32_large/current
time: [1.6701 µs 1.6717 µs 1.6734 µs]
thrpt: [597.59 Melem/s 598.20 Melem/s 598.77
Melem/s]
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
write_varint64_small/current
time: [1.1521 µs 1.1594 µs 1.1669 µs]
thrpt: [856.95 Melem/s 862.49 Melem/s 868.01
Melem/s]
Found 14 outliers among 100 measurements (14.00%)
1 (1.00%) low severe
3 (3.00%) low mild
10 (10.00%) high mild
write_varint64_medium/current
time: [1.7693 µs 1.7748 µs 1.7802 µs]
thrpt: [561.73 Melem/s 563.45 Melem/s 565.18
Melem/s]
write_varint64_large/current
time: [2.8024 µs 2.8496 µs 2.9050 µs]
thrpt: [344.24 Melem/s 350.93 Melem/s 356.84
Melem/s]
Found 38 outliers among 100 measurements (38.00%)
16 (16.00%) low severe
6 (6.00%) low mild
1 (1.00%) high mild
15 (15.00%) high severe
fory/benchmarks/rust on feat/rust-sizeguards [$✘?] is v0.17.0-alpha.0
via v3.14.3 via v1.95.0 on (us-east-1) took 5s
❯ cargo bench --bench buffer_write_bench -- --baseline main
Finished `bench` profile [optimized] target(s) in 0.06s
Running benches/buffer_write_bench.rs
(target/release/deps/buffer_write_bench-011c6e0ee322c976)
Gnuplot not found, using plotters backend
write_u8/current time: [6.8933 µs 6.9147 µs 6.9399 µs]
thrpt: [144.09 Melem/s 144.62 Melem/s 145.07
Melem/s]
change:
time: [-2.0992% -1.4519% -0.9010%] (p = 0.00 <
0.05)
thrpt: [+0.9091% +1.4733% +2.1442%]
Change within noise threshold.
Found 20 outliers among 100 measurements (20.00%)
6 (6.00%) high mild
14 (14.00%) high severe
write_i32/current time: [729.41 ns 732.87 ns 736.71 ns]
thrpt: [1.3574 Gelem/s 1.3645 Gelem/s 1.3710
Gelem/s]
change:
time: [-2.2545% -1.4650% -0.3802%] (p = 0.00 <
0.05)
thrpt: [+0.3817% +1.4868% +2.3065%]
Change within noise threshold.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) high mild
5 (5.00%) high severe
write_i64/current time: [741.69 ns 743.49 ns 745.33 ns]
thrpt: [1.3417 Gelem/s 1.3450 Gelem/s 1.3483
Gelem/s]
change:
time: [-1.2781% -0.9131% -0.5686%] (p = 0.00 <
0.05)
thrpt: [+0.5718% +0.9215% +1.2947%]
Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
write_f32/current time: [814.51 ns 818.90 ns 823.47 ns]
thrpt: [1.2144 Gelem/s 1.2211 Gelem/s 1.2277
Gelem/s]
change:
time: [-2.0663% -1.1408% -0.1963%] (p = 0.02 <
0.05)
thrpt: [+0.1966% +1.1540% +2.1099%]
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
write_f64/current time: [823.12 ns 827.97 ns 833.88 ns]
thrpt: [1.1992 Gelem/s 1.2078 Gelem/s 1.2149
Gelem/s]
change:
time: [-6.2183% -4.5369% -2.9123%] (p = 0.00 <
0.05)
thrpt: [+2.9997% +4.7525% +6.6306%]
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
write_varint32_small/current
time: [899.07 ns 905.35 ns 914.34 ns]
thrpt: [1.0937 Gelem/s 1.1045 Gelem/s 1.1123
Gelem/s]
change:
time: [-0.7350% +0.7029% +2.6802%] (p = 0.46 >
0.05)
thrpt: [-2.6103% -0.6980% +0.7405%]
No change in performance detected.
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) low severe
1 (1.00%) low mild
2 (2.00%) high mild
3 (3.00%) high severe
write_varint32_medium/current
time: [1.4128 µs 1.4142 µs 1.4159 µs]
thrpt: [706.29 Melem/s 707.09 Melem/s 707.83
Melem/s]
change:
time: [-0.6195% -0.3812% -0.1441%] (p = 0.00 <
0.05)
thrpt: [+0.1443% +0.3827% +0.6233%]
Change within noise threshold.
Found 11 outliers among 100 measurements (11.00%)
1 (1.00%) low severe
1 (1.00%) low mild
6 (6.00%) high mild
3 (3.00%) high severe
write_varint32_large/current
time: [1.6586 µs 1.6692 µs 1.6780 µs]
thrpt: [595.95 Melem/s 599.07 Melem/s 602.92
Melem/s]
change:
time: [-0.5057% -0.1241% +0.1752%] (p = 0.49 >
0.05)
thrpt: [-0.1749% +0.1243% +0.5083%]
No change in performance detected.
Found 9 outliers among 100 measurements (9.00%)
1 (1.00%) low severe
1 (1.00%) low mild
3 (3.00%) high mild
4 (4.00%) high severe
write_varint64_small/current
time: [1.1234 µs 1.1247 µs 1.1260 µs]
thrpt: [888.12 Melem/s 889.16 Melem/s 890.17
Melem/s]
change:
time: [-2.1981% -1.4802% -0.7546%] (p = 0.00 <
0.05)
thrpt: [+0.7604% +1.5024% +2.2475%]
Change within noise threshold.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) low severe
3 (3.00%) high mild
2 (2.00%) high severe
write_varint64_medium/current
time: [1.7863 µs 1.7907 µs 1.7945 µs]
thrpt: [557.25 Melem/s 558.43 Melem/s 559.83
Melem/s]
change:
time: [-0.1626% +0.2047% +0.5850%] (p = 0.27 >
0.05)
thrpt: [-0.5816% -0.2042% +0.1629%]
No change in performance detected.
write_varint64_large/current
time: [2.7535 µs 2.7624 µs 2.7721 µs]
thrpt: [360.74 Melem/s 362.00 Melem/s 363.17
Melem/s]
change:
time: [-3.0492% -1.9645% -1.0085%] (p = 0.00 <
0.05)
thrpt: [+1.0188% +2.0038% +3.1451%]
Performance has improved.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
