github-actions[bot] commented on PR #7341: URL: https://github.com/apache/texera/pull/7341#issuecomment-5197694499
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 8 worse · ⚪ 7 noise (<±5%) · 0 without baseline > Compared against main `f46b2a7` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/31049155020) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 374 | 0.228 | 26,417/34,522/34,522 us | 🔴 -6.2% / 🔴 +117.1% | | 🔴 | bs=100 sw=10 sl=64 | 775 | 0.473 | 123,640/170,658/170,658 us | 🔴 +15.0% / 🔴 +55.6% | | 🔴 | bs=1000 sw=10 sl=64 | 906 | 0.553 | 1,100,106/1,243,390/1,243,390 us | 🔴 +8.3% / 🔴 +18.9% | <details><summary>Baseline details</summary> Latest main `f46b2a7` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 374 tuples/sec | 398 tuples/sec | 762.27 tuples/sec | -6.0% | -50.9% | | bs=10 sw=10 sl=64 | MB/s | 0.228 MB/s | 0.243 MB/s | 0.465 MB/s | -6.2% | -51.0% | | bs=10 sw=10 sl=64 | p50 | 26,417 us | 25,980 us | 12,866 us | +1.7% | +105.3% | | bs=10 sw=10 sl=64 | p95 | 34,522 us | 33,540 us | 15,903 us | +2.9% | +117.1% | | bs=10 sw=10 sl=64 | p99 | 34,522 us | 33,540 us | 19,260 us | +2.9% | +79.2% | | bs=100 sw=10 sl=64 | throughput | 775 tuples/sec | 818 tuples/sec | 966.64 tuples/sec | -5.3% | -19.8% | | bs=100 sw=10 sl=64 | MB/s | 0.473 MB/s | 0.499 MB/s | 0.59 MB/s | -5.2% | -19.8% | | bs=100 sw=10 sl=64 | p50 | 123,640 us | 120,094 us | 103,594 us | +3.0% | +19.4% | | bs=100 sw=10 sl=64 | p95 | 170,658 us | 148,391 us | 109,677 us | +15.0% | +55.6% | | bs=100 sw=10 sl=64 | p99 | 170,658 us | 148,391 us | 120,247 us | +15.0% | +41.9% | | bs=1000 sw=10 sl=64 | throughput | 906 tuples/sec | 923 tuples/sec | 998.67 tuples/sec | -1.8% | -9.3% | | bs=1000 sw=10 sl=64 | MB/s | 0.553 MB/s | 0.564 MB/s | 0.61 MB/s | -2.0% | -9.3% | | bs=1000 sw=10 sl=64 | p50 | 1,100,106 us | 1,078,300 us | 1,009,199 us | +2.0% | +9.0% | | bs=1000 sw=10 sl=64 | p95 | 1,243,390 us | 1,147,748 us | 1,045,335 us | +8.3% | +18.9% | | bs=1000 sw=10 sl=64 | p99 | 1,243,390 us | 1,147,748 us | 1,076,869 us | +8.3% | +15.5% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,534.47,200,128000,374,0.228,26416.79,34521.50,34521.50 1,100,10,64,20,2581.74,2000,1280000,775,0.473,123640.22,170658.09,170658.09 2,1000,10,64,20,22075.86,20000,12800000,906,0.553,1100106.34,1243389.78,1243389.78 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
