Kimahriman commented on PR #34558: URL: https://github.com/apache/spark/pull/34558#issuecomment-2736265492
I added a simple benchmark, local results: ``` [info] Running benchmark: transform [info] Running case: codegen [info] Stopped after 10 iterations, 4605 ms [info] Running case: interpreted [info] Stopped after 10 iterations, 16947 ms [info] OpenJDK 64-Bit Server VM 17.0.12+0 on Mac OS X 14.7.4 [info] Apple M1 Max [info] transform: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative [info] ------------------------------------------------------------------------------------------------------------------------ [info] codegen 371 461 54 26.9 37.1 1.0X [info] interpreted 1615 1695 86 6.2 161.5 0.2X [info] Running benchmark: filter [info] Running case: codegen [info] Stopped after 10 iterations, 4042 ms [info] Running case: interpreted [info] Stopped after 10 iterations, 16382 ms [info] OpenJDK 64-Bit Server VM 17.0.12+0 on Mac OS X 14.7.4 [info] Apple M1 Max [info] filter: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative [info] ------------------------------------------------------------------------------------------------------------------------ [info] codegen 360 404 45 27.8 36.0 1.0X [info] interpreted 1589 1638 53 6.3 158.9 0.2X [info] Running benchmark: forall - fast [info] Running case: codegen [info] Stopped after 10 iterations, 2129 ms [info] Running case: interpreted [info] Stopped after 10 iterations, 7804 ms [info] OpenJDK 64-Bit Server VM 17.0.12+0 on Mac OS X 14.7.4 [info] Apple M1 Max [info] forall - fast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative [info] ------------------------------------------------------------------------------------------------------------------------ [info] codegen 199 213 9 50.4 19.9 1.0X [info] interpreted 749 780 24 13.4 74.9 0.3X [info] Running benchmark: forall - slow [info] Running case: codegen [info] Stopped after 10 iterations, 2570 ms [info] Running case: interpreted [info] Stopped after 10 iterations, 8253 ms [info] OpenJDK 64-Bit Server VM 17.0.12+0 on Mac OS X 14.7.4 [info] Apple M1 Max [info] forall - slow: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative [info] ------------------------------------------------------------------------------------------------------------------------ [info] codegen 240 257 17 41.7 24.0 1.0X [info] interpreted 801 825 23 12.5 80.1 0.3X [info] Running benchmark: exists - fast [info] Running case: codegen [info] Stopped after 10 iterations, 2061 ms [info] Running case: interpreted [info] Stopped after 10 iterations, 8190 ms [info] OpenJDK 64-Bit Server VM 17.0.12+0 on Mac OS X 14.7.4 [info] Apple M1 Max [info] exists - fast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative [info] ------------------------------------------------------------------------------------------------------------------------ [info] codegen 188 206 21 53.2 18.8 1.0X [info] interpreted 794 819 25 12.6 79.4 0.2X [info] Running benchmark: exists - slow [info] Running case: codegen [info] Stopped after 10 iterations, 2441 ms [info] Running case: interpreted [info] Stopped after 10 iterations, 8876 ms [info] OpenJDK 64-Bit Server VM 17.0.12+0 on Mac OS X 14.7.4 [info] Apple M1 Max [info] exists - slow: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative [info] ------------------------------------------------------------------------------------------------------------------------ [info] codegen 232 244 14 43.1 23.2 1.0X [info] interpreted 857 888 32 11.7 85.7 0.3X [info] Running benchmark: aggregate [info] Running case: codegen [info] Stopped after 10 iterations, 4029 ms [info] Running case: interpreted [info] Stopped after 10 iterations, 12054 ms [info] OpenJDK 64-Bit Server VM 17.0.12+0 on Mac OS X 14.7.4 [info] Apple M1 Max [info] aggregate: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative [info] ------------------------------------------------------------------------------------------------------------------------ [info] codegen 381 403 18 26.3 38.1 1.0X [info] interpreted 1157 1205 34 8.6 115.7 0.3X ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
