UBarney commented on issue #16710: URL: https://github.com/apache/datafusion/issues/16710#issuecomment-3084255495
> > > Updated: our benchmark is using datafusion internal source to benchmark instead of datafusion-python, i am not sure if it will make a difference. > > > > > > The results are similar when running with datafusion-python as well. > > Interesting [@UBarney](https://github.com/UBarney) , so next step is to see if the dataset is different. @zhuqi-lucas Agreed. The selectivity of the join condition on a specific dataset could affect performance. Perhaps we can start by comparing the number of rows in the result sets returned by these queries. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
