github-actions[bot] commented on PR #7359: URL: https://github.com/apache/texera/pull/7359#issuecomment-5216247686
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 8 worse · ⚪ 7 noise (<±5%) · 0 without baseline > Compared against main `5fe5fde` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/31172364549) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 358 | 0.219 | 28,172/34,261/34,261 us | 🔴 -10.3% / 🔴 +118.3% | | 🔴 | bs=100 sw=10 sl=64 | 736 | 0.449 | 127,692/210,128/210,128 us | 🔴 +33.0% / 🔴 +89.8% | | ⚪ | bs=1000 sw=10 sl=64 | 893 | 0.545 | 1,115,474/1,226,705/1,226,705 us | ⚪ within ±5% / 🔴 +16.2% | <details><summary>Baseline details</summary> Latest main `5fe5fde` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 358 tuples/sec | 399 tuples/sec | 757.88 tuples/sec | -10.3% | -52.8% | | bs=10 sw=10 sl=64 | MB/s | 0.219 MB/s | 0.243 MB/s | 0.463 MB/s | -9.9% | -52.7% | | bs=10 sw=10 sl=64 | p50 | 28,172 us | 25,762 us | 12,904 us | +9.4% | +118.3% | | bs=10 sw=10 sl=64 | p95 | 34,261 us | 32,857 us | 16,065 us | +4.3% | +113.3% | | bs=10 sw=10 sl=64 | p99 | 34,261 us | 32,857 us | 19,384 us | +4.3% | +76.7% | | bs=100 sw=10 sl=64 | throughput | 736 tuples/sec | 789 tuples/sec | 957.87 tuples/sec | -6.7% | -23.2% | | bs=100 sw=10 sl=64 | MB/s | 0.449 MB/s | 0.482 MB/s | 0.585 MB/s | -6.8% | -23.2% | | bs=100 sw=10 sl=64 | p50 | 127,692 us | 120,621 us | 104,502 us | +5.9% | +22.2% | | bs=100 sw=10 sl=64 | p95 | 210,128 us | 158,008 us | 110,735 us | +33.0% | +89.8% | | bs=100 sw=10 sl=64 | p99 | 210,128 us | 158,008 us | 120,386 us | +33.0% | +74.5% | | bs=1000 sw=10 sl=64 | throughput | 893 tuples/sec | 905 tuples/sec | 988.88 tuples/sec | -1.3% | -9.7% | | bs=1000 sw=10 sl=64 | MB/s | 0.545 MB/s | 0.553 MB/s | 0.604 MB/s | -1.4% | -9.7% | | bs=1000 sw=10 sl=64 | p50 | 1,115,474 us | 1,103,139 us | 1,018,589 us | +1.1% | +9.5% | | bs=1000 sw=10 sl=64 | p95 | 1,226,705 us | 1,185,430 us | 1,056,001 us | +3.5% | +16.2% | | bs=1000 sw=10 sl=64 | p99 | 1,226,705 us | 1,185,430 us | 1,087,982 us | +3.5% | +12.8% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,558.18,200,128000,358,0.219,28171.64,34261.29,34261.29 1,100,10,64,20,2716.43,2000,1280000,736,0.449,127692.03,210128.04,210128.04 2,1000,10,64,20,22398.89,20000,12800000,893,0.545,1115474.49,1226705.10,1226705.10 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
