songwdfu commented on PR #16336:
URL: https://github.com/apache/pinot/pull/16336#issuecomment-3106285282
Some benchmarking results of **combine only**, ran on 8 core laptop with
around 8G mem available during benchmarking.
```
Benchmark
(_limit) (_numRadixBit) (_numRecordsPerSegment) (_numSegments) Mode Cnt
Score Error Units
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
500 3 1000 20 avgt 3
9859.666 ± 1036.984 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
500 3 1000 50 avgt 3
27076.322 ± 1407.219 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
500 3 10000 20 avgt 3
107321.281 ± 24976.556 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
500 3 10000 50 avgt 3
355915.278 ± 35039.948 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
500 4 1000 20 avgt 3
9871.386 ± 1336.446 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
500 4 1000 50 avgt 3
27001.071 ± 3957.131 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
500 4 10000 20 avgt 3
103414.720 ± 17423.547 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
500 4 10000 50 avgt 3
337134.879 ± 54358.131 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
1000000000 3 1000 20 avgt 3
3402.615 ± 2389.462 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
1000000000 3 1000 50 avgt 3
11278.182 ± 12320.068 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
1000000000 3 10000 20 avgt 3
55913.786 ± 80490.198 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
1000000000 3 10000 50 avgt 3
228514.561 ± 76456.937 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
1000000000 4 1000 20 avgt 3
3123.019 ± 1760.373 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
1000000000 4 1000 50 avgt 3
10976.702 ± 4350.025 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
1000000000 4 10000 20 avgt 3
55652.140 ± 53988.136 us/op
BenchmarkPartitionedCombineGroupBy.concurrentIndexedTableForCombineGroupBy
1000000000 4 10000 50 avgt 3
225054.759 ± 35126.220 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
500 3 1000 20 avgt 3
1751.810 ± 2183.484 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
500 3 1000 50 avgt 3
8249.037 ± 2572.934 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
500 3 10000 20 avgt 3
58489.671 ± 17416.080 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
500 3 10000 50 avgt 3
157780.673 ± 10014.853 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
500 4 1000 20 avgt 3
1621.109 ± 300.276 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
500 4 1000 50 avgt 3
4099.596 ± 769.760 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
500 4 10000 20 avgt 3
36730.365 ± 18045.586 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
500 4 10000 50 avgt 3
110616.453 ± 40224.979 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
1000000000 3 1000 20 avgt 3
1805.468 ± 938.640 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
1000000000 3 1000 50 avgt 3
4917.023 ± 1069.911 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
1000000000 3 10000 20 avgt 3
29374.659 ± 9887.782 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
1000000000 3 10000 50 avgt 3
79065.833 ± 33782.037 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
1000000000 4 1000 20 avgt 3
1638.536 ± 462.033 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
1000000000 4 1000 50 avgt 3
3881.508 ± 4748.240 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
1000000000 4 10000 20 avgt 3
26766.352 ± 11842.681 us/op
BenchmarkPartitionedCombineGroupBy.partitionedCombineGroupBy
1000000000 4 10000 50 avgt 3
70754.878 ± 5626.250 us/op
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
