Re: [I] Profile memory usage and add guidance to the tuning guide [datafusion-comet]

2025-03-19 Thread via GitHub
andygrove closed issue #1315: Profile memory usage and add guidance to the tuning guide URL: https://github.com/apache/datafusion-comet/issues/1315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [I] Profile memory usage and add guidance to the tuning guide [datafusion-comet]

2025-03-12 Thread via GitHub
andygrove commented on issue #1315: URL: https://github.com/apache/datafusion-comet/issues/1315#issuecomment-2719217924 I have been testing with TPC-H @ 100 GB. https://github.com/user-attachments/assets/aa41a5b4-9820-4de3-960a-8caa5f67cdb8"; /> Conclusions: - Spark nee

[I] Profile memory usage and add guidance to the tuning guide [datafusion-comet]

2025-01-21 Thread via GitHub
andygrove opened a new issue, #1315: URL: https://github.com/apache/datafusion-comet/issues/1315 ### What is the problem the feature request solves? We do not yet have any documentation explaining how much off-heap memory Comet uses compared to Spark. We should profile this and add do