github-actions[bot] commented on PR #6043: URL: https://github.com/apache/texera/pull/6043#issuecomment-4849424630
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 7 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `434bcae` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/28487053093) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 410 | 0.25 | 22,918/35,195/35,195 us | 🔴 +19.1% / 🔴 +133.5% | | 🔴 | bs=100 sw=10 sl=64 | 944 | 0.576 | 104,876/134,307/134,307 us | 🔴 +5.4% / 🔴 +24.8% | | ⚪ | bs=1000 sw=10 sl=64 | 1,090 | 0.665 | 921,644/955,630/955,630 us | ⚪ within ±5% / 🟢 -9.7% | <details><summary>Baseline details</summary> Latest main `434bcae` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 410 tuples/sec | 449 tuples/sec | 777.62 tuples/sec | -8.7% | -47.3% | | bs=10 sw=10 sl=64 | MB/s | 0.25 MB/s | 0.274 MB/s | 0.475 MB/s | -8.8% | -47.3% | | bs=10 sw=10 sl=64 | p50 | 22,918 us | 21,707 us | 12,612 us | +5.6% | +81.7% | | bs=10 sw=10 sl=64 | p95 | 35,195 us | 29,556 us | 15,070 us | +19.1% | +133.5% | | bs=10 sw=10 sl=64 | p99 | 35,195 us | 29,556 us | 18,360 us | +19.1% | +91.7% | | bs=100 sw=10 sl=64 | throughput | 944 tuples/sec | 952 tuples/sec | 988.31 tuples/sec | -0.8% | -4.5% | | bs=100 sw=10 sl=64 | MB/s | 0.576 MB/s | 0.581 MB/s | 0.603 MB/s | -0.9% | -4.5% | | bs=100 sw=10 sl=64 | p50 | 104,876 us | 103,340 us | 101,066 us | +1.5% | +3.8% | | bs=100 sw=10 sl=64 | p95 | 134,307 us | 127,372 us | 107,594 us | +5.4% | +24.8% | | bs=100 sw=10 sl=64 | p99 | 134,307 us | 127,372 us | 115,830 us | +5.4% | +16.0% | | bs=1000 sw=10 sl=64 | throughput | 1,090 tuples/sec | 1,102 tuples/sec | 1,019 tuples/sec | -1.1% | +6.9% | | bs=1000 sw=10 sl=64 | MB/s | 0.665 MB/s | 0.673 MB/s | 0.622 MB/s | -1.2% | +6.9% | | bs=1000 sw=10 sl=64 | p50 | 921,644 us | 908,151 us | 986,982 us | +1.5% | -6.6% | | bs=1000 sw=10 sl=64 | p95 | 955,630 us | 956,512 us | 1,028,491 us | -0.1% | -7.1% | | bs=1000 sw=10 sl=64 | p99 | 955,630 us | 956,512 us | 1,058,493 us | -0.1% | -9.7% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,487.74,200,128000,410,0.250,22918.15,35194.86,35194.86 1,100,10,64,20,2117.71,2000,1280000,944,0.576,104875.58,134307.22,134307.22 2,1000,10,64,20,18346.69,20000,12800000,1090,0.665,921643.60,955629.68,955629.68 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
