github-actions[bot] commented on PR #6286: URL: https://github.com/apache/texera/pull/6286#issuecomment-4922940783
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 5 worse · ⚪ 10 noise (<±5%) · 0 without baseline > Compared against main `27f145a` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/29003148359) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 422 | 0.258 | 22,809/33,733/33,733 us | 🔴 +13.8% / 🔴 +115.6% | | ⚪ | bs=100 sw=10 sl=64 | 975 | 0.595 | 101,327/129,650/129,650 us | ⚪ within ±5% / 🔴 +18.8% | | 🔴 | bs=1000 sw=10 sl=64 | 1,085 | 0.663 | 920,266/1,069,988/1,069,988 us | 🔴 +11.1% / 🟢 +8.6% | <details><summary>Baseline details</summary> Latest main `27f145a` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 422 tuples/sec | 458 tuples/sec | 760.25 tuples/sec | -7.9% | -44.5% | | bs=10 sw=10 sl=64 | MB/s | 0.258 MB/s | 0.28 MB/s | 0.464 MB/s | -7.9% | -44.4% | | bs=10 sw=10 sl=64 | p50 | 22,809 us | 20,048 us | 12,873 us | +13.8% | +77.2% | | bs=10 sw=10 sl=64 | p95 | 33,733 us | 32,301 us | 15,648 us | +4.4% | +115.6% | | bs=10 sw=10 sl=64 | p99 | 33,733 us | 32,301 us | 19,338 us | +4.4% | +74.4% | | bs=100 sw=10 sl=64 | throughput | 975 tuples/sec | 983 tuples/sec | 974.75 tuples/sec | -0.8% | +0.0% | | bs=100 sw=10 sl=64 | MB/s | 0.595 MB/s | 0.6 MB/s | 0.595 MB/s | -0.8% | +0.0% | | bs=100 sw=10 sl=64 | p50 | 101,327 us | 98,942 us | 102,470 us | +2.4% | -1.1% | | bs=100 sw=10 sl=64 | p95 | 129,650 us | 128,271 us | 109,144 us | +1.1% | +18.8% | | bs=100 sw=10 sl=64 | p99 | 129,650 us | 128,271 us | 115,530 us | +1.1% | +12.2% | | bs=1000 sw=10 sl=64 | throughput | 1,085 tuples/sec | 1,106 tuples/sec | 1,000 tuples/sec | -1.9% | +8.5% | | bs=1000 sw=10 sl=64 | MB/s | 0.663 MB/s | 0.675 MB/s | 0.61 MB/s | -1.8% | +8.6% | | bs=1000 sw=10 sl=64 | p50 | 920,266 us | 913,112 us | 1,005,545 us | +0.8% | -8.5% | | bs=1000 sw=10 sl=64 | p95 | 1,069,988 us | 963,203 us | 1,045,968 us | +11.1% | +2.3% | | bs=1000 sw=10 sl=64 | p99 | 1,069,988 us | 963,203 us | 1,076,800 us | +11.1% | -0.6% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,473.64,200,128000,422,0.258,22809.05,33733.24,33733.24 1,100,10,64,20,2051.31,2000,1280000,975,0.595,101327.16,129649.79,129649.79 2,1000,10,64,20,18425.37,20000,12800000,1085,0.663,920265.54,1069987.54,1069987.54 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
