github-actions[bot] commented on PR #6187: URL: https://github.com/apache/texera/pull/6187#issuecomment-4886976866
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 6 worse · ⚪ 7 noise (<±5%) · 0 without baseline > Compared against main `6e25ffb` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/28748924412) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 662 | 0.404 | 15,041/18,301/18,301 us | 🔴 +15.4% / 🔴 +20.3% | | 🔴 | bs=100 sw=10 sl=64 | 1,674 | 1.022 | 60,577/64,765/64,765 us | 🔴 +9.5% / 🟢 +69.6% | | ⚪ | bs=1000 sw=10 sl=64 | 2,011 | 1.227 | 495,216/530,748/530,748 us | ⚪ within ±5% / 🟢 +96.9% | <details><summary>Baseline details</summary> Latest main `6e25ffb` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 662 tuples/sec | 721 tuples/sec | 777.63 tuples/sec | -8.2% | -14.9% | | bs=10 sw=10 sl=64 | MB/s | 0.404 MB/s | 0.44 MB/s | 0.475 MB/s | -8.2% | -14.9% | | bs=10 sw=10 sl=64 | p50 | 15,041 us | 13,032 us | 12,603 us | +15.4% | +19.3% | | bs=10 sw=10 sl=64 | p95 | 18,301 us | 21,201 us | 15,215 us | -13.7% | +20.3% | | bs=10 sw=10 sl=64 | p99 | 18,301 us | 21,201 us | 18,617 us | -13.7% | -1.7% | | bs=100 sw=10 sl=64 | throughput | 1,674 tuples/sec | 1,779 tuples/sec | 987.11 tuples/sec | -5.9% | +69.6% | | bs=100 sw=10 sl=64 | MB/s | 1.022 MB/s | 1.086 MB/s | 0.602 MB/s | -5.9% | +69.6% | | bs=100 sw=10 sl=64 | p50 | 60,577 us | 55,329 us | 101,428 us | +9.5% | -40.3% | | bs=100 sw=10 sl=64 | p95 | 64,765 us | 65,762 us | 107,959 us | -1.5% | -40.0% | | bs=100 sw=10 sl=64 | p99 | 64,765 us | 65,762 us | 114,777 us | -1.5% | -43.6% | | bs=1000 sw=10 sl=64 | throughput | 2,011 tuples/sec | 2,024 tuples/sec | 1,021 tuples/sec | -0.6% | +96.9% | | bs=1000 sw=10 sl=64 | MB/s | 1.227 MB/s | 1.235 MB/s | 0.623 MB/s | -0.6% | +96.8% | | bs=1000 sw=10 sl=64 | p50 | 495,216 us | 494,033 us | 986,363 us | +0.2% | -49.8% | | bs=1000 sw=10 sl=64 | p95 | 530,748 us | 511,080 us | 1,026,594 us | +3.8% | -48.3% | | bs=1000 sw=10 sl=64 | p99 | 530,748 us | 511,080 us | 1,054,559 us | +3.8% | -49.7% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,301.90,200,128000,662,0.404,15041.47,18301.38,18301.38 1,100,10,64,20,1194.53,2000,1280000,1674,1.022,60577.24,64765.21,64765.21 2,1000,10,64,20,9946.58,20000,12800000,2011,1.227,495215.84,530747.89,530747.89 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
