github-actions[bot] commented on PR #7347: URL: https://github.com/apache/texera/pull/7347#issuecomment-5198959861
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 7 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `69c66a1` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/31059252166) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 353 | 0.216 | 26,472/45,499/45,499 us | 🔴 +26.4% / 🔴 +186.1% | | ⚪ | bs=100 sw=10 sl=64 | 777 | 0.474 | 125,700/152,452/152,452 us | ⚪ within ±5% / 🔴 +39.0% | | 🔴 | bs=1000 sw=10 sl=64 | 907 | 0.554 | 1,095,247/1,232,245/1,232,245 us | 🔴 +9.0% / 🔴 +17.9% | <details><summary>Baseline details</summary> Latest main `69c66a1` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 353 tuples/sec | 409 tuples/sec | 762.27 tuples/sec | -13.7% | -53.7% | | bs=10 sw=10 sl=64 | MB/s | 0.216 MB/s | 0.25 MB/s | 0.465 MB/s | -13.6% | -53.6% | | bs=10 sw=10 sl=64 | p50 | 26,472 us | 22,187 us | 12,866 us | +19.3% | +105.8% | | bs=10 sw=10 sl=64 | p95 | 45,499 us | 36,002 us | 15,903 us | +26.4% | +186.1% | | bs=10 sw=10 sl=64 | p99 | 45,499 us | 36,002 us | 19,260 us | +26.4% | +136.2% | | bs=100 sw=10 sl=64 | throughput | 777 tuples/sec | 808 tuples/sec | 966.64 tuples/sec | -3.8% | -19.6% | | bs=100 sw=10 sl=64 | MB/s | 0.474 MB/s | 0.493 MB/s | 0.59 MB/s | -3.9% | -19.7% | | bs=100 sw=10 sl=64 | p50 | 125,700 us | 122,565 us | 103,594 us | +2.6% | +21.3% | | bs=100 sw=10 sl=64 | p95 | 152,452 us | 150,063 us | 109,677 us | +1.6% | +39.0% | | bs=100 sw=10 sl=64 | p99 | 152,452 us | 150,063 us | 120,247 us | +1.6% | +26.8% | | bs=1000 sw=10 sl=64 | throughput | 907 tuples/sec | 915 tuples/sec | 998.67 tuples/sec | -0.9% | -9.2% | | bs=1000 sw=10 sl=64 | MB/s | 0.554 MB/s | 0.559 MB/s | 0.61 MB/s | -0.9% | -9.1% | | bs=1000 sw=10 sl=64 | p50 | 1,095,247 us | 1,095,985 us | 1,009,199 us | -0.1% | +8.5% | | bs=1000 sw=10 sl=64 | p95 | 1,232,245 us | 1,130,587 us | 1,045,335 us | +9.0% | +17.9% | | bs=1000 sw=10 sl=64 | p99 | 1,232,245 us | 1,130,587 us | 1,076,869 us | +9.0% | +14.4% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,566.28,200,128000,353,0.216,26472.01,45499.28,45499.28 1,100,10,64,20,2573.82,2000,1280000,777,0.474,125699.59,152452.18,152452.18 2,1000,10,64,20,22048.90,20000,12800000,907,0.554,1095246.50,1232244.65,1232244.65 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
