2010YOUY01 commented on issue #22723: URL: https://github.com/apache/datafusion/issues/22723#issuecomment-4655116556
> SOmething I am not quite sure about is if there is a bug in the current code (where the stated policy, however flawed, is not actually followed by the current code)? @alamb Yes, this is possible. The challenge is for `slt` scale queries they can't be easily caught due to temporary batches noises. If we scale up the queries (GBs of memory), then those temporary batches memory become a small constant, and the accounted memory and actual memory can be validated against each other. We could definitely set them up in CI, ideally once we get more CI resources to run those slow and memory-consuming queries. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
