github-actions[bot] commented on PR #8600: URL: https://github.com/apache/texera/pull/8600#issuecomment-5736989449
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 4 better · 🔴 3 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `e7d1676` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/35401589478) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 392 | 0.239 | 24,952/33,121/33,121 us | 🔴 +19.5% / 🔴 +114.3% | | 🟢 | bs=100 sw=10 sl=64 | 803 | 0.49 | 123,603/147,189/147,189 us | 🟢 -14.1% / 🔴 +39.0% | | ⚪ | bs=1000 sw=10 sl=64 | 909 | 0.555 | 1,091,171/1,179,158/1,179,158 us | ⚪ within ±5% / 🔴 +15.7% | <details><summary>Baseline details</summary> Latest main `e7d1676` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 392 tuples/sec | 419 tuples/sec | 796.29 tuples/sec | -6.4% | -50.8% | | bs=10 sw=10 sl=64 | MB/s | 0.239 MB/s | 0.256 MB/s | 0.486 MB/s | -6.6% | -50.8% | | bs=10 sw=10 sl=64 | p50 | 24,952 us | 20,883 us | 12,549 us | +19.5% | +98.8% | | bs=10 sw=10 sl=64 | p95 | 33,121 us | 36,738 us | 15,458 us | -9.8% | +114.3% | | bs=10 sw=10 sl=64 | p99 | 33,121 us | 36,738 us | 19,275 us | -9.8% | +71.8% | | bs=100 sw=10 sl=64 | throughput | 803 tuples/sec | 812 tuples/sec | 1,027 tuples/sec | -1.1% | -21.8% | | bs=100 sw=10 sl=64 | MB/s | 0.49 MB/s | 0.496 MB/s | 0.627 MB/s | -1.2% | -21.8% | | bs=100 sw=10 sl=64 | p50 | 123,603 us | 120,603 us | 100,085 us | +2.5% | +23.5% | | bs=100 sw=10 sl=64 | p95 | 147,189 us | 171,286 us | 105,895 us | -14.1% | +39.0% | | bs=100 sw=10 sl=64 | p99 | 147,189 us | 171,286 us | 116,076 us | -14.1% | +26.8% | | bs=1000 sw=10 sl=64 | throughput | 909 tuples/sec | 914 tuples/sec | 1,055 tuples/sec | -0.5% | -13.9% | | bs=1000 sw=10 sl=64 | MB/s | 0.555 MB/s | 0.558 MB/s | 0.644 MB/s | -0.5% | -13.8% | | bs=1000 sw=10 sl=64 | p50 | 1,091,171 us | 1,093,690 us | 979,292 us | -0.2% | +11.4% | | bs=1000 sw=10 sl=64 | p95 | 1,179,158 us | 1,138,720 us | 1,018,835 us | +3.6% | +15.7% | | bs=1000 sw=10 sl=64 | p99 | 1,179,158 us | 1,138,720 us | 1,039,692 us | +3.6% | +13.4% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,510.06,200,128000,392,0.239,24952.06,33121.10,33121.10 1,100,10,64,20,2489.93,2000,1280000,803,0.490,123602.77,147188.65,147188.65 2,1000,10,64,20,22006.74,20000,12800000,909,0.555,1091170.60,1179158.41,1179158.41 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
