alamb commented on issue #13748: URL: https://github.com/apache/datafusion/issues/13748#issuecomment-2540011097
I tested this with various released versions: ### `42.0.0`: Worst case takes 7.5 seconds ``` Running with 10 columns...completed in 25.767125ms Running with 20 columns...completed in 59.605292ms Running with 30 columns...completed in 151.040583ms Running with 40 columns...completed in 352.528417ms Running with 50 columns...completed in 701.194625ms Running with 60 columns...completed in 1.259548375s Running with 70 columns...completed in 2.142141458s Running with 80 columns...completed in 3.42683925s Running with 90 columns...completed in 5.22279025s Running with 100 columns...completed in 7.59148425s ``` ### `43.0.0`: Same as reported above (123.150163417s) ### `main` I also tested with main as of now: https://github.com/apache/datafusion/commit/36a1361807060b5221291e5c8a7d59d7acf7954a It is better, but still quite a bit worse than 42 ``` Running with 10 columns...completed in 35.857458ms Running with 20 columns...completed in 102.454125ms Running with 30 columns...completed in 429.636584ms Running with 40 columns...completed in 1.403798625s Running with 50 columns...completed in 3.770518708s Running with 60 columns...completed in 8.758160834s Running with 70 columns...completed in 18.022044708s Running with 80 columns...completed in 34.337127625s Running with 90 columns...completed in 60.926777084s Running with 100 columns...completed in 101.470021875s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
