mbutrovich commented on issue #1598: URL: https://github.com/apache/datafusion-comet/issues/1598#issuecomment-2786513619
> > > Unfortunately can't see any visible gains of working with comet vs bare Spark 😕 > > > > > > Were you able to confirm that queries were running in Comet? > > After testing on much heavier input/shuffle/output (200GB/2TB/100GB) the performance boost was amazing, 2x at least. Thanks for help. Wow that's phenomenal! Are you able to share some (vague if necessary) descriptions of your workload, cluster hardware, and what sort of tuning (if any) you had to do with Comet? We'd love to be able to improve our documentation to help folks see results like that. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
