Dandandan commented on issue #13099: URL: https://github.com/apache/datafusion/issues/13099#issuecomment-2495622657
> The polars test is in python so I don't think that is a fair comparison I don't think that's very relevant, as the execution is done natively (Polars is written in Rust). Likewise, DataFusion also would perform about the same in Python. Running on the biggest machine / and / or reading everything in memory actually gives Polars an advantage, so I think it’s even more impressive to see the difference here. I think it mainly shows the different optimizations done last ~2 years to make (tricky/expensive) aggregations fast. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
