coderfender commented on PR #2600:
URL:
https://github.com/apache/datafusion-comet/pull/2600#issuecomment-3645020170
Ran benchmarking with ANSI mode enabled for SUM aggregated function only and
here are the results
```
Running benchmark: Grouped HashAgg Exec: single group key (cardinality 100),
single aggregate SUM, ansi mode enabled : true
Running case: SQL Parquet - Spark (SUM) ansi mode enabled : true
Stopped after 32 iterations, 2013 ms
Running case: SQL Parquet - Comet (SUM) ansi mode enabled : true
Stopped after 38 iterations, 2032 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 100), single aggregate
SUM, ansi mode enabled : true: Best Time(ms) Avg Time(ms) Stdev(ms)
Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) ansi mode enabled : true
48 63 17
219.2 4.6 1.0X
SQL Parquet - Comet (SUM) ansi mode enabled : true
36 53 17
289.7 3.5 1.3X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality
1024), single aggregate SUM, ansi mode enabled : true
Running case: SQL Parquet - Spark (SUM) ansi mode enabled : true
Stopped after 30 iterations, 2071 ms
Running case: SQL Parquet - Comet (SUM) ansi mode enabled : true
Stopped after 36 iterations, 2011 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 1024), single aggregate
SUM, ansi mode enabled : true: Best Time(ms) Avg Time(ms) Stdev(ms)
Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) ansi mode enabled : true
47 69 13
221.2 4.5 1.0X
SQL Parquet - Comet (SUM) ansi mode enabled : true
35 56 33
303.5 3.3 1.4X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality
1048576), single aggregate SUM, ansi mode enabled : true
Running case: SQL Parquet - Spark (SUM) ansi mode enabled : true
Stopped after 33 iterations, 2049 ms
Running case: SQL Parquet - Comet (SUM) ansi mode enabled : true
Stopped after 33 iterations, 2035 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 1048576), single
aggregate SUM, ansi mode enabled : true: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) ansi mode enabled : true
50 62 17
211.4 4.7 1.0X
SQL Parquet - Comet (SUM) ansi mode enabled : true
37 62 33
281.9 3.5 1.3X
Running benchmark: Grouped HashAgg Exec: multiple group keys (cardinality
100), single aggregate SUM
Running case: SQL Parquet - Spark (SUM) isANSIMode: true
Stopped after 32 iterations, 2026 ms
Running case: SQL Parquet - Comet (SUM) isANSIMode: true
Stopped after 34 iterations, 2010 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: multiple group keys (cardinality 100), single
aggregate SUM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) isANSIMode: true
49 63 23 213.9 4.7
1.0X
SQL Parquet - Comet (SUM) isANSIMode: true
36 59 23 287.7 3.5
1.3X
Running benchmark: Grouped HashAgg Exec: multiple group keys (cardinality
1024), single aggregate SUM
Running case: SQL Parquet - Spark (SUM) isANSIMode: true
Stopped after 29 iterations, 2131 ms
Running case: SQL Parquet - Comet (SUM) isANSIMode: true
Stopped after 43 iterations, 2014 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: multiple group keys (cardinality 1024), single
aggregate SUM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) isANSIMode: true
48 73 32 217.1 4.6
1.0X
SQL Parquet - Comet (SUM) isANSIMode: true
36 47 18 290.1 3.4
1.3X
Running benchmark: Grouped HashAgg Exec: multiple group keys (cardinality
1048576), single aggregate SUM
Running case: SQL Parquet - Spark (SUM) isANSIMode: true
Stopped after 2 iterations, 2952 ms
Running case: SQL Parquet - Comet (SUM) isANSIMode: true
Stopped after 5 iterations, 2276 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: multiple group keys (cardinality 1048576), single
aggregate SUM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) isANSIMode: true
1463 1476 18 7.2 139.5
1.0X
SQL Parquet - Comet (SUM) isANSIMode: true
396 455 92 26.5 37.8
3.7X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality 100),
multiple aggregates SUM isANSIMode: true
Running case: SQL Parquet - Spark (SUM) isANSIMode: true
Stopped after 13 iterations, 2075 ms
Running case: SQL Parquet - Comet (SUM) isANSIMode: true
Stopped after 35 iterations, 2051 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 100), multiple
aggregates SUM isANSIMode: true: Best Time(ms) Avg Time(ms) Stdev(ms)
Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) isANSIMode: true
56 160 78 188.0
5.3 1.0X
SQL Parquet - Comet (SUM) isANSIMode: true
34 59 45 309.5
3.2 1.6X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality
1024), multiple aggregates SUM isANSIMode: true
Running case: SQL Parquet - Spark (SUM) isANSIMode: true
Stopped after 16 iterations, 2103 ms
Running case: SQL Parquet - Comet (SUM) isANSIMode: true
Stopped after 37 iterations, 2016 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 1024), multiple
aggregates SUM isANSIMode: true: Best Time(ms) Avg Time(ms) Stdev(ms)
Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) isANSIMode: true
55 131 97 189.6
5.3 1.0X
SQL Parquet - Comet (SUM) isANSIMode: true
38 54 30 273.0
3.7 1.4X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality
1048576), multiple aggregates SUM isANSIMode: true
Running case: SQL Parquet - Spark (SUM) isANSIMode: true
Stopped after 20 iterations, 2118 ms
Running case: SQL Parquet - Comet (SUM) isANSIMode: true
Stopped after 22 iterations, 2025 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 1048576), multiple
aggregates SUM isANSIMode: true: Best Time(ms) Avg Time(ms) Stdev(ms)
Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) isANSIMode: true
55 106 71
189.8 5.3 1.0X
SQL Parquet - Comet (SUM) isANSIMode: true
35 92 73
301.9 3.3 1.6X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality 100),
single aggregate SUM on decimal
Running case: SQL Parquet - Spark (SUM) ansi mode enabled : true
Stopped after 2 iterations, 2658 ms
Running case: SQL Parquet - Comet (SUM) ansi mode enabled : true
Stopped after 9 iterations, 2233 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 100), single aggregate
SUM on decimal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) ansi mode enabled : true
1257 1329 102 8.3
119.9 1.0X
SQL Parquet - Comet (SUM) ansi mode enabled : true
237 248 15 44.2
22.6 5.3X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality
1024), single aggregate SUM on decimal
Running case: SQL Parquet - Spark (SUM) ansi mode enabled : true
Stopped after 2 iterations, 2615 ms
Running case: SQL Parquet - Comet (SUM) ansi mode enabled : true
Stopped after 8 iterations, 2222 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 1024), single aggregate
SUM on decimal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) ansi mode enabled : true
1307 1308 0 8.0
124.7 1.0X
SQL Parquet - Comet (SUM) ansi mode enabled : true
257 278 29 40.7
24.6 5.1X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality
1048576), single aggregate SUM on decimal
Running case: SQL Parquet - Spark (SUM) ansi mode enabled : true
Stopped after 2 iterations, 8222 ms
Running case: SQL Parquet - Comet (SUM) ansi mode enabled : true
Stopped after 2 iterations, 2853 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 1048576), single
aggregate SUM on decimal: Best Time(ms) Avg Time(ms) Stdev(ms)
Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) ansi mode enabled : true
4082 4111 42 2.6
389.3 1.0X
SQL Parquet - Comet (SUM) ansi mode enabled : true
1412 1427 20 7.4
134.7 2.9X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality 100),
single aggregate SUM, ansi mode enabled : false
Running case: SQL Parquet - Spark (SUM) ansi mode enabled : false
Stopped after 9 iterations, 2064 ms
Running case: SQL Parquet - Comet (SUM) ansi mode enabled : false
Stopped after 12 iterations, 2025 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 100), single aggregate
SUM, ansi mode enabled : false: Best Time(ms) Avg Time(ms) Stdev(ms)
Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) ansi mode enabled : false
221 229 12
47.5 21.0 1.0X
SQL Parquet - Comet (SUM) ansi mode enabled : false
153 169 25
68.5 14.6 1.4X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality
1024), single aggregate SUM, ansi mode enabled : false
Running case: SQL Parquet - Spark (SUM) ansi mode enabled : false
Stopped after 9 iterations, 2207 ms
Running case: SQL Parquet - Comet (SUM) ansi mode enabled : false
Stopped after 12 iterations, 2053 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 1024), single aggregate
SUM, ansi mode enabled : false: Best Time(ms) Avg Time(ms) Stdev(ms)
Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) ansi mode enabled : false
226 245 30
46.4 21.6 1.0X
SQL Parquet - Comet (SUM) ansi mode enabled : false
165 171 4
63.4 15.8 1.4X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality
1048576), single aggregate SUM, ansi mode enabled : false
Running case: SQL Parquet - Spark (SUM) ansi mode enabled : false
Stopped after 2 iterations, 4153 ms
Running case: SQL Parquet - Comet (SUM) ansi mode enabled : false
Stopped after 3 iterations, 2645 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 1048576), single
aggregate SUM, ansi mode enabled : false: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) ansi mode enabled : false
2069 2077 11
5.1 197.3 1.0X
SQL Parquet - Comet (SUM) ansi mode enabled : false
841 882 49
12.5 80.2 2.5X
Running benchmark: Grouped HashAgg Exec: multiple group keys (cardinality
100), single aggregate SUM
Running case: SQL Parquet - Spark (SUM) isANSIMode: false
Stopped after 4 iterations, 2340 ms
Running case: SQL Parquet - Comet (SUM) isANSIMode: false
Stopped after 8 iterations, 2320 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: multiple group keys (cardinality 100), single
aggregate SUM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) isANSIMode: false
574 585 12 18.3 54.8
1.0X
SQL Parquet - Comet (SUM) isANSIMode: false
269 290 33 39.0 25.6
2.1X
Running benchmark: Grouped HashAgg Exec: multiple group keys (cardinality
1024), single aggregate SUM
Running case: SQL Parquet - Spark (SUM) isANSIMode: false
Stopped after 2 iterations, 5877 ms
Running case: SQL Parquet - Comet (SUM) isANSIMode: false
Stopped after 2 iterations, 2924 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: multiple group keys (cardinality 1024), single
aggregate SUM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) isANSIMode: false
2896 2939 60 3.6 276.2
1.0X
SQL Parquet - Comet (SUM) isANSIMode: false
1400 1462 88 7.5 133.5
2.1X
Running benchmark: Grouped HashAgg Exec: multiple group keys (cardinality
1048576), single aggregate SUM
Running case: SQL Parquet - Spark (SUM) isANSIMode: false
Stopped after 2 iterations, 13239 ms
Running case: SQL Parquet - Comet (SUM) isANSIMode: false
Stopped after 2 iterations, 10603 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: multiple group keys (cardinality 1048576), single
aggregate SUM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) isANSIMode: false
6580 6620 57 1.6 627.5
1.0X
SQL Parquet - Comet (SUM) isANSIMode: false
5265 5302 52 2.0 502.1
1.2X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality 100),
multiple aggregates SUM isANSIMode: false
Running case: SQL Parquet - Spark (SUM) isANSIMode: false
Stopped after 6 iterations, 2011 ms
Running case: SQL Parquet - Comet (SUM) isANSIMode: false
Stopped after 9 iterations, 2165 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 100), multiple
aggregates SUM isANSIMode: false: Best Time(ms) Avg Time(ms) Stdev(ms)
Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) isANSIMode: false
290 335 74 36.2
27.7 1.0X
SQL Parquet - Comet (SUM) isANSIMode: false
207 241 59 50.6
19.8 1.4X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality
1024), multiple aggregates SUM isANSIMode: false
Running case: SQL Parquet - Spark (SUM) isANSIMode: false
Stopped after 6 iterations, 2031 ms
Running case: SQL Parquet - Comet (SUM) isANSIMode: false
Stopped after 9 iterations, 2281 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 1024), multiple
aggregates SUM isANSIMode: false: Best Time(ms) Avg Time(ms) Stdev(ms)
Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) isANSIMode: false
303 339 54 34.6
28.9 1.0X
SQL Parquet - Comet (SUM) isANSIMode: false
227 253 32 46.2
21.7 1.3X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality
1048576), multiple aggregates SUM isANSIMode: false
Running case: SQL Parquet - Spark (SUM) isANSIMode: false
Stopped after 2 iterations, 6469 ms
Running case: SQL Parquet - Comet (SUM) isANSIMode: false
Stopped after 2 iterations, 3608 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 1048576), multiple
aggregates SUM isANSIMode: false: Best Time(ms) Avg Time(ms) Stdev(ms)
Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) isANSIMode: false
3222 3235 18
3.3 307.3 1.0X
SQL Parquet - Comet (SUM) isANSIMode: false
1562 1804 343
6.7 148.9 2.1X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality 100),
single aggregate SUM on decimal
Running case: SQL Parquet - Spark (SUM) ansi mode enabled : false
Stopped after 2 iterations, 2433 ms
Running case: SQL Parquet - Comet (SUM) ansi mode enabled : false
Stopped after 8 iterations, 2034 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 100), single aggregate
SUM on decimal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) ansi mode enabled : false
1210 1217 10 8.7
115.4 1.0X
SQL Parquet - Comet (SUM) ansi mode enabled : false
249 254 4 42.0
23.8 4.9X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality
1024), single aggregate SUM on decimal
Running case: SQL Parquet - Spark (SUM) ansi mode enabled : false
Stopped after 2 iterations, 2483 ms
Running case: SQL Parquet - Comet (SUM) ansi mode enabled : false
Stopped after 7 iterations, 2099 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 1024), single aggregate
SUM on decimal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) ansi mode enabled : false
1235 1242 10 8.5
117.7 1.0X
SQL Parquet - Comet (SUM) ansi mode enabled : false
255 300 54 41.2
24.3 4.8X
Running benchmark: Grouped HashAgg Exec: single group key (cardinality
1048576), single aggregate SUM on decimal
Running case: SQL Parquet - Spark (SUM) ansi mode enabled : false
Stopped after 2 iterations, 8194 ms
Running case: SQL Parquet - Comet (SUM) ansi mode enabled : false
Stopped after 2 iterations, 2820 ms
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Grouped HashAgg Exec: single group key (cardinality 1048576), single
aggregate SUM on decimal: Best Time(ms) Avg Time(ms) Stdev(ms)
Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark (SUM) ansi mode enabled : false
4069 4097 40 2.6
388.0 1.0X
SQL Parquet - Comet (SUM) ansi mode enabled : false
1381 1410 42 7.6
131.7 2.9X
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
