pepijnve commented on issue #16490: URL: https://github.com/apache/datafusion/issues/16490#issuecomment-2992478294
What the article describes is pretty much what datafusion is already doing I guess. What I observed, but only at a glance, is that all cores are kept busy when the benchmarks are running. The hypothesis I had was that perhaps unfortunate placement of work (number crunching in efficiency and waiting for io on performance for instance) could lead to suboptimal performance. I’m not super familiar with Instruments, but maybe it has a way to make the io vs cpu work visible in the profiler somehow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
