github-actions[bot] commented on PR #5961:
URL: https://github.com/apache/texera/pull/5961#issuecomment-4823456654

   <!-- texera-benchmarks-comment -->
   ## ✅ No material benchmark regressions detected
   
   🟢 5 better · 🔴 0 worse · ⚪ 10 noise (<±5%) · 0 without baseline
   
   > Compared against main `7944c09` benchmarked on **this same runner**, so 
the delta is largely free of cross-runner hardware noise. The "7d avg" column 
still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated.
   
   [Dashboard](https://apache.github.io/texera/dev/bench/) · 
[Run](https://github.com/apache/texera/actions/runs/28306597655)
   
   | | config | throughput | MB/s | latency | max Δ latest / 7d |
   |---|---|---:|---:|---:|---:|
   | 🟢 | bs=10 sw=10 sl=64 | 431 | 0.263 | 22,073/33,176/33,176 us | 🟢 -18.2% / 
🔴 +114.6% |
   | ⚪ | bs=100 sw=10 sl=64 | 941 | 0.574 | 103,358/130,389/130,389 us | ⚪ 
within ±5% / 🔴 +18.5% |
   | ⚪ | bs=1000 sw=10 sl=64 | 1,110 | 0.678 | 901,572/927,639/927,639 us | ⚪ 
within ±5% / 🟢 -14.6% |
   
   <details><summary>Baseline details</summary>
   
   Latest main `7944c09` from same runner
   
   | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d |
   |---|---|---:|---:|---:|---:|---:|
   | bs=10 sw=10 sl=64 | throughput | 431 tuples/sec | 403 tuples/sec | 756.6 
tuples/sec | +6.9% | -43.0% |
   | bs=10 sw=10 sl=64 | MB/s | 0.263 MB/s | 0.246 MB/s | 0.462 MB/s | +6.9% | 
-43.0% |
   | bs=10 sw=10 sl=64 | p50 | 22,073 us | 24,900 us | 13,009 us | -11.4% | 
+69.7% |
   | bs=10 sw=10 sl=64 | p95 | 33,176 us | 40,568 us | 15,463 us | -18.2% | 
+114.6% |
   | bs=10 sw=10 sl=64 | p99 | 33,176 us | 40,568 us | 18,561 us | -18.2% | 
+78.7% |
   | bs=100 sw=10 sl=64 | throughput | 941 tuples/sec | 969 tuples/sec | 963.83 
tuples/sec | -2.9% | -2.4% |
   | bs=100 sw=10 sl=64 | MB/s | 0.574 MB/s | 0.592 MB/s | 0.588 MB/s | -3.0% | 
-2.4% |
   | bs=100 sw=10 sl=64 | p50 | 103,358 us | 99,990 us | 103,320 us | +3.4% | 
+0.0% |
   | bs=100 sw=10 sl=64 | p95 | 130,389 us | 134,288 us | 110,058 us | -2.9% | 
+18.5% |
   | bs=100 sw=10 sl=64 | p99 | 130,389 us | 134,288 us | 118,543 us | -2.9% | 
+10.0% |
   | bs=1000 sw=10 sl=64 | throughput | 1,110 tuples/sec | 1,125 tuples/sec | 
989.07 tuples/sec | -1.3% | +12.2% |
   | bs=1000 sw=10 sl=64 | MB/s | 0.678 MB/s | 0.687 MB/s | 0.604 MB/s | -1.3% 
| +12.3% |
   | bs=1000 sw=10 sl=64 | p50 | 901,572 us | 883,283 us | 1,015,599 us | +2.1% 
| -11.2% |
   | bs=1000 sw=10 sl=64 | p95 | 927,639 us | 943,452 us | 1,055,944 us | -1.7% 
| -12.2% |
   | bs=1000 sw=10 sl=64 | p99 | 927,639 us | 943,452 us | 1,086,834 us | -1.7% 
| -14.6% |
   
   </details>
   
   <details><summary>Raw CSV</summary>
   
   ```csv
   
config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us
   0,10,10,64,20,463.95,200,128000,431,0.263,22073.15,33176.46,33176.46
   1,100,10,64,20,2124.93,2000,1280000,941,0.574,103357.62,130388.54,130388.54
   
2,1000,10,64,20,18016.08,20000,12800000,1110,0.678,901571.78,927638.54,927638.54
   ```
   
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to