github-actions[bot] commented on PR #7374: URL: https://github.com/apache/texera/pull/7374#issuecomment-5210296923
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 4 worse · ⚪ 9 noise (<±5%) · 0 without baseline > Compared against main `18a277c` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/31134126772) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 443 | 0.27 | 22,062/27,831/27,831 us | 🟢 -11.4% / 🔴 +73.2% | | 🔴 | bs=100 sw=10 sl=64 | 940 | 0.574 | 102,331/159,216/159,216 us | 🔴 +16.7% / 🔴 +43.8% | | ⚪ | bs=1000 sw=10 sl=64 | 1,089 | 0.665 | 911,692/956,089/956,089 us | ⚪ within ±5% / 🟢 -12.1% | <details><summary>Baseline details</summary> Latest main `18a277c` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 443 tuples/sec | 471 tuples/sec | 757.88 tuples/sec | -5.9% | -41.5% | | bs=10 sw=10 sl=64 | MB/s | 0.27 MB/s | 0.287 MB/s | 0.463 MB/s | -5.9% | -41.6% | | bs=10 sw=10 sl=64 | p50 | 22,062 us | 21,451 us | 12,904 us | +2.8% | +71.0% | | bs=10 sw=10 sl=64 | p95 | 27,831 us | 31,426 us | 16,065 us | -11.4% | +73.2% | | bs=10 sw=10 sl=64 | p99 | 27,831 us | 31,426 us | 19,384 us | -11.4% | +43.6% | | bs=100 sw=10 sl=64 | throughput | 940 tuples/sec | 972 tuples/sec | 957.87 tuples/sec | -3.3% | -1.9% | | bs=100 sw=10 sl=64 | MB/s | 0.574 MB/s | 0.593 MB/s | 0.585 MB/s | -3.2% | -1.8% | | bs=100 sw=10 sl=64 | p50 | 102,331 us | 100,466 us | 104,502 us | +1.9% | -2.1% | | bs=100 sw=10 sl=64 | p95 | 159,216 us | 136,470 us | 110,735 us | +16.7% | +43.8% | | bs=100 sw=10 sl=64 | p99 | 159,216 us | 136,470 us | 120,386 us | +16.7% | +32.3% | | bs=1000 sw=10 sl=64 | throughput | 1,089 tuples/sec | 1,125 tuples/sec | 988.88 tuples/sec | -3.2% | +10.1% | | bs=1000 sw=10 sl=64 | MB/s | 0.665 MB/s | 0.687 MB/s | 0.604 MB/s | -3.2% | +10.2% | | bs=1000 sw=10 sl=64 | p50 | 911,692 us | 889,371 us | 1,018,589 us | +2.5% | -10.5% | | bs=1000 sw=10 sl=64 | p95 | 956,089 us | 950,991 us | 1,056,001 us | +0.5% | -9.5% | | bs=1000 sw=10 sl=64 | p99 | 956,089 us | 950,991 us | 1,087,982 us | +0.5% | -12.1% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,451.62,200,128000,443,0.270,22061.90,27830.73,27830.73 1,100,10,64,20,2128.50,2000,1280000,940,0.574,102331.27,159215.68,159215.68 2,1000,10,64,20,18357.69,20000,12800000,1089,0.665,911691.99,956089.14,956089.14 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
