github-actions[bot] commented on PR #7373: URL: https://github.com/apache/texera/pull/7373#issuecomment-5210285150
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 6 better · 🔴 3 worse · ⚪ 6 noise (<±5%) · 0 without baseline > Compared against main `18a277c` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/31134071306) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 614 | 0.375 | 15,741/21,114/21,114 us | 🟢 -17.5% / 🔴 +31.4% | | 🟢 | bs=100 sw=10 sl=64 | 1,289 | 0.787 | 77,943/88,968/88,968 us | 🟢 -32.0% / 🟢 +34.6% | | 🔴 | bs=1000 sw=10 sl=64 | 1,456 | 0.889 | 679,371/820,279/820,279 us | 🔴 +16.4% / 🟢 +47.3% | <details><summary>Baseline details</summary> Latest main `18a277c` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 614 tuples/sec | 640 tuples/sec | 757.88 tuples/sec | -4.1% | -19.0% | | bs=10 sw=10 sl=64 | MB/s | 0.375 MB/s | 0.391 MB/s | 0.463 MB/s | -4.1% | -18.9% | | bs=10 sw=10 sl=64 | p50 | 15,741 us | 13,576 us | 12,904 us | +15.9% | +22.0% | | bs=10 sw=10 sl=64 | p95 | 21,114 us | 25,592 us | 16,065 us | -17.5% | +31.4% | | bs=10 sw=10 sl=64 | p99 | 21,114 us | 25,592 us | 19,384 us | -17.5% | +8.9% | | bs=100 sw=10 sl=64 | throughput | 1,289 tuples/sec | 1,213 tuples/sec | 957.87 tuples/sec | +6.3% | +34.6% | | bs=100 sw=10 sl=64 | MB/s | 0.787 MB/s | 0.74 MB/s | 0.585 MB/s | +6.4% | +34.6% | | bs=100 sw=10 sl=64 | p50 | 77,943 us | 75,778 us | 104,502 us | +2.9% | -25.4% | | bs=100 sw=10 sl=64 | p95 | 88,968 us | 130,850 us | 110,735 us | -32.0% | -19.7% | | bs=100 sw=10 sl=64 | p99 | 88,968 us | 130,850 us | 120,386 us | -32.0% | -26.1% | | bs=1000 sw=10 sl=64 | throughput | 1,456 tuples/sec | 1,523 tuples/sec | 988.88 tuples/sec | -4.4% | +47.2% | | bs=1000 sw=10 sl=64 | MB/s | 0.889 MB/s | 0.93 MB/s | 0.604 MB/s | -4.4% | +47.3% | | bs=1000 sw=10 sl=64 | p50 | 679,371 us | 652,911 us | 1,018,589 us | +4.1% | -33.3% | | bs=1000 sw=10 sl=64 | p95 | 820,279 us | 704,624 us | 1,056,001 us | +16.4% | -22.3% | | bs=1000 sw=10 sl=64 | p99 | 820,279 us | 704,624 us | 1,087,982 us | +16.4% | -24.6% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,325.58,200,128000,614,0.375,15741.46,21114.09,21114.09 1,100,10,64,20,1551.24,2000,1280000,1289,0.787,77943.31,88967.67,88967.67 2,1000,10,64,20,13737.37,20000,12800000,1456,0.889,679371.36,820278.58,820278.58 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
