github-actions[bot] commented on PR #7343: URL: https://github.com/apache/texera/pull/7343#issuecomment-5198205775
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 4 better · 🔴 3 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `f46b2a7` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/31053294729) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🟢 | bs=10 sw=10 sl=64 | 567 | 0.346 | 17,006/21,645/21,645 us | 🟢 -30.1% / 🔴 +36.1% | | 🔴 | bs=100 sw=10 sl=64 | 1,170 | 0.714 | 83,508/108,747/108,747 us | 🟢 -11.2% / 🟢 +21.0% | | 🔴 | bs=1000 sw=10 sl=64 | 1,383 | 0.844 | 719,157/835,583/835,583 us | 🔴 +5.8% / 🟢 +38.5% | <details><summary>Baseline details</summary> Latest main `f46b2a7` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 567 tuples/sec | 571 tuples/sec | 762.27 tuples/sec | -0.7% | -25.6% | | bs=10 sw=10 sl=64 | MB/s | 0.346 MB/s | 0.348 MB/s | 0.465 MB/s | -0.6% | -25.6% | | bs=10 sw=10 sl=64 | p50 | 17,006 us | 16,860 us | 12,866 us | +0.9% | +32.2% | | bs=10 sw=10 sl=64 | p95 | 21,645 us | 30,968 us | 15,903 us | -30.1% | +36.1% | | bs=10 sw=10 sl=64 | p99 | 21,645 us | 30,968 us | 19,260 us | -30.1% | +12.4% | | bs=100 sw=10 sl=64 | throughput | 1,170 tuples/sec | 1,200 tuples/sec | 966.64 tuples/sec | -2.5% | +21.0% | | bs=100 sw=10 sl=64 | MB/s | 0.714 MB/s | 0.732 MB/s | 0.59 MB/s | -2.5% | +21.0% | | bs=100 sw=10 sl=64 | p50 | 83,508 us | 77,233 us | 103,594 us | +8.1% | -19.4% | | bs=100 sw=10 sl=64 | p95 | 108,747 us | 122,531 us | 109,677 us | -11.2% | -0.8% | | bs=100 sw=10 sl=64 | p99 | 108,747 us | 122,531 us | 120,247 us | -11.2% | -9.6% | | bs=1000 sw=10 sl=64 | throughput | 1,383 tuples/sec | 1,433 tuples/sec | 998.67 tuples/sec | -3.5% | +38.5% | | bs=1000 sw=10 sl=64 | MB/s | 0.844 MB/s | 0.875 MB/s | 0.61 MB/s | -3.5% | +38.5% | | bs=1000 sw=10 sl=64 | p50 | 719,157 us | 695,328 us | 1,009,199 us | +3.4% | -28.7% | | bs=1000 sw=10 sl=64 | p95 | 835,583 us | 790,109 us | 1,045,335 us | +5.8% | -20.1% | | bs=1000 sw=10 sl=64 | p99 | 835,583 us | 790,109 us | 1,076,869 us | +5.8% | -22.4% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,352.46,200,128000,567,0.346,17006.13,21645.23,21645.23 1,100,10,64,20,1709.49,2000,1280000,1170,0.714,83508.41,108747.43,108747.43 2,1000,10,64,20,14461.91,20000,12800000,1383,0.844,719156.53,835583.19,835583.19 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
