github-actions[bot] commented on PR #7375: URL: https://github.com/apache/texera/pull/7375#issuecomment-5210309329
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 5 worse · ⚪ 10 noise (<±5%) · 0 without baseline > Compared against main `18a277c` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/31134176450) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 380 | 0.232 | 24,496/37,345/37,345 us | 🔴 -12.1% / 🔴 +132.5% | | ⚪ | bs=100 sw=10 sl=64 | 782 | 0.477 | 125,723/143,656/143,656 us | ⚪ within ±5% / 🔴 +29.7% | | ⚪ | bs=1000 sw=10 sl=64 | 919 | 0.561 | 1,086,534/1,167,893/1,167,893 us | ⚪ within ±5% / 🔴 +10.6% | <details><summary>Baseline details</summary> Latest main `18a277c` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 380 tuples/sec | 432 tuples/sec | 757.88 tuples/sec | -12.0% | -49.9% | | bs=10 sw=10 sl=64 | MB/s | 0.232 MB/s | 0.264 MB/s | 0.463 MB/s | -12.1% | -49.8% | | bs=10 sw=10 sl=64 | p50 | 24,496 us | 22,678 us | 12,904 us | +8.0% | +89.8% | | bs=10 sw=10 sl=64 | p95 | 37,345 us | 33,399 us | 16,065 us | +11.8% | +132.5% | | bs=10 sw=10 sl=64 | p99 | 37,345 us | 33,399 us | 19,384 us | +11.8% | +92.7% | | bs=100 sw=10 sl=64 | throughput | 782 tuples/sec | 821 tuples/sec | 957.87 tuples/sec | -4.8% | -18.4% | | bs=100 sw=10 sl=64 | MB/s | 0.477 MB/s | 0.501 MB/s | 0.585 MB/s | -4.8% | -18.4% | | bs=100 sw=10 sl=64 | p50 | 125,723 us | 119,875 us | 104,502 us | +4.9% | +20.3% | | bs=100 sw=10 sl=64 | p95 | 143,656 us | 147,626 us | 110,735 us | -2.7% | +29.7% | | bs=100 sw=10 sl=64 | p99 | 143,656 us | 147,626 us | 120,386 us | -2.7% | +19.3% | | bs=1000 sw=10 sl=64 | throughput | 919 tuples/sec | 914 tuples/sec | 988.88 tuples/sec | +0.5% | -7.1% | | bs=1000 sw=10 sl=64 | MB/s | 0.561 MB/s | 0.558 MB/s | 0.604 MB/s | +0.5% | -7.1% | | bs=1000 sw=10 sl=64 | p50 | 1,086,534 us | 1,095,424 us | 1,018,589 us | -0.8% | +6.7% | | bs=1000 sw=10 sl=64 | p95 | 1,167,893 us | 1,148,130 us | 1,056,001 us | +1.7% | +10.6% | | bs=1000 sw=10 sl=64 | p99 | 1,167,893 us | 1,148,130 us | 1,087,982 us | +1.7% | +7.3% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,526.63,200,128000,380,0.232,24496.29,37345.15,37345.15 1,100,10,64,20,2556.99,2000,1280000,782,0.477,125723.30,143655.96,143655.96 2,1000,10,64,20,21758.40,20000,12800000,919,0.561,1086534.42,1167893.07,1167893.07 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
