sqlbenchmark commented on PR #1431:
URL:
https://github.com/apache/datafusion-ballista/pull/1431#issuecomment-3829532619
## Ballista Criterion Benchmark Results
**PR:** #1431 - fix: add missing batch_size argument to benchmark
**PR Commit:** `89699c71`
**Base Commit:** `9f786fc3` (PR #1434)
**Bench:** sort_shuffle
### Baseline (PR #1434)
```
info: syncing channel updates for 'stable-x86_64-unknown-linux-gnu'
info: latest update on 2026-01-22, rust version 1.93.0 (254b59607 2026-01-19)
info: downloading component 'cargo'
info: downloading component 'rust-std'
info: downloading component 'rustc'
info: installing component 'cargo'
info: installing component 'rust-std'
info: installing component 'rustc'
Gnuplot not found, using plotters backend
Benchmarking sort_shuffle_no_spill/10_batches_200_partitions
Benchmarking sort_shuffle_no_spill/10_batches_200_partitions: Warming up for
3.0000 s
Benchmarking sort_shuffle_no_spill/10_batches_200_partitions: Collecting 10
samples in estimated 6.1474 s (30 iterations)
Benchmarking sort_shuffle_no_spill/10_batches_200_partitions: Analyzing
sort_shuffle_no_spill/10_batches_200_partitions
time: [206.72 ms 207.66 ms 208.58 ms]
Benchmarking sort_shuffle_no_spill/50_batches_200_partitions
Benchmarking sort_shuffle_no_spill/50_batches_200_partitions: Warming up for
3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase
target time to 21.0s.
Benchmarking sort_shuffle_no_spill/50_batches_200_partitions: Collecting 10
samples in estimated 20.977 s (10 iterations)
Benchmarking sort_shuffle_no_spill/50_batches_200_partitions: Analyzing
sort_shuffle_no_spill/50_batches_200_partitions
time: [2.0811 s 2.1597 s 2.2314 s]
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit:
Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase
target time to 22.0s.
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit:
Collecting 10 samples in estimated 21.968 s (10 iterations)
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit:
Analyzing
sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit
time: [2.1551 s 2.1802 s 2.2056 s]
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit:
Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase
target time to 24.3s.
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit:
Collecting 10 samples in estimated 24.274 s (10 iterations)
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit:
Analyzing
sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit
time: [2.3612 s 2.3815 s 2.4034 s]
```
### PR branch
```
Gnuplot not found, using plotters backend
Benchmarking sort_shuffle_no_spill/10_batches_200_partitions
Benchmarking sort_shuffle_no_spill/10_batches_200_partitions: Warming up for
3.0000 s
Benchmarking sort_shuffle_no_spill/10_batches_200_partitions: Collecting 10
samples in estimated 8.4349 s (110 iterations)
Benchmarking sort_shuffle_no_spill/10_batches_200_partitions: Analyzing
sort_shuffle_no_spill/10_batches_200_partitions
time: [73.966 ms 74.378 ms 75.090 ms]
change: [-64.171% -63.726% -63.280%] (p = 0.00 <
0.05)
Performance has improved.
Benchmarking sort_shuffle_no_spill/50_batches_200_partitions
Benchmarking sort_shuffle_no_spill/50_batches_200_partitions: Warming up for
3.0000 s
Benchmarking sort_shuffle_no_spill/50_batches_200_partitions: Collecting 10
samples in estimated 6.9208 s (20 iterations)
Benchmarking sort_shuffle_no_spill/50_batches_200_partitions: Analyzing
sort_shuffle_no_spill/50_batches_200_partitions
time: [346.24 ms 348.48 ms 350.91 ms]
change: [-84.396% -83.864% -83.245%] (p = 0.00 <
0.05)
Performance has improved.
Found 4 outliers among 10 measurements (40.00%)
2 (20.00%) low mild
1 (10.00%) high mild
1 (10.00%) high severe
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit:
Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase
target time to 13.9s.
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit:
Collecting 10 samples in estimated 13.898 s (10 iterations)
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit:
Analyzing
sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit
time: [1.3633 s 1.3760 s 1.3915 s]
change: [-37.809% -36.887% -35.916%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high mild
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit:
Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase
target time to 18.2s.
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit:
Collecting 10 samples in estimated 18.157 s (10 iterations)
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit:
Analyzing
sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit
time: [1.8903 s 1.9251 s 1.9608 s]
change: [-20.922% -19.164% -17.606%] (p = 0.00 <
0.05)
Performance has improved.
```
---
*Automated benchmark run by dfbench*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
