github-actions[bot] commented on PR #8379: URL: https://github.com/apache/texera/pull/8379#issuecomment-5528008676
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 3 worse · ⚪ 12 noise (<±5%) · 0 without baseline > Compared against main `cd4fd5a` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/33771389850) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 400 | 0.244 | 24,437/33,416/33,416 us | 🔴 +12.9% / 🔴 +109.1% | | ⚪ | bs=100 sw=10 sl=64 | 810 | 0.495 | 121,056/142,936/142,936 us | ⚪ within ±5% / 🔴 +30.8% | | ⚪ | bs=1000 sw=10 sl=64 | 920 | 0.561 | 1,088,495/1,160,948/1,160,948 us | ⚪ within ±5% / 🔴 +11.3% | <details><summary>Baseline details</summary> Latest main `cd4fd5a` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 400 tuples/sec | 432 tuples/sec | 755.36 tuples/sec | -7.4% | -47.0% | | bs=10 sw=10 sl=64 | MB/s | 0.244 MB/s | 0.264 MB/s | 0.461 MB/s | -7.6% | -47.1% | | bs=10 sw=10 sl=64 | p50 | 24,437 us | 21,653 us | 12,938 us | +12.9% | +88.9% | | bs=10 sw=10 sl=64 | p95 | 33,416 us | 33,170 us | 15,980 us | +0.7% | +109.1% | | bs=10 sw=10 sl=64 | p99 | 33,416 us | 33,170 us | 19,233 us | +0.7% | +73.7% | | bs=100 sw=10 sl=64 | throughput | 810 tuples/sec | 826 tuples/sec | 976.3 tuples/sec | -1.9% | -17.0% | | bs=100 sw=10 sl=64 | MB/s | 0.495 MB/s | 0.504 MB/s | 0.596 MB/s | -1.8% | -16.9% | | bs=100 sw=10 sl=64 | p50 | 121,056 us | 120,240 us | 102,340 us | +0.7% | +18.3% | | bs=100 sw=10 sl=64 | p95 | 142,936 us | 136,715 us | 109,262 us | +4.6% | +30.8% | | bs=100 sw=10 sl=64 | p99 | 142,936 us | 136,715 us | 118,827 us | +4.6% | +20.3% | | bs=1000 sw=10 sl=64 | throughput | 920 tuples/sec | 924 tuples/sec | 1,006 tuples/sec | -0.4% | -8.6% | | bs=1000 sw=10 sl=64 | MB/s | 0.561 MB/s | 0.564 MB/s | 0.614 MB/s | -0.5% | -8.7% | | bs=1000 sw=10 sl=64 | p50 | 1,088,495 us | 1,082,192 us | 999,855 us | +0.6% | +8.9% | | bs=1000 sw=10 sl=64 | p95 | 1,160,948 us | 1,139,669 us | 1,042,833 us | +1.9% | +11.3% | | bs=1000 sw=10 sl=64 | p99 | 1,160,948 us | 1,139,669 us | 1,070,722 us | +1.9% | +8.4% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,499.97,200,128000,400,0.244,24437.14,33416.10,33416.10 1,100,10,64,20,2468.28,2000,1280000,810,0.495,121055.85,142936.10,142936.10 2,1000,10,64,20,21745.97,20000,12800000,920,0.561,1088494.90,1160947.68,1160947.68 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
