xiangfu0 opened a new pull request, #16378: URL: https://github.com/apache/pinot/pull/16378
This commit adds a new feature that allows operators to examine per-thread memory usage and proactively terminate queries when they exceed configured memory limits, preventing system-wide OOM issues. Key Changes: - Add checkMemoryAndInterruptIfExceeded() to ThreadResourceUsageAccountant interface - Implement memory checking logic in PerQueryCPUMemAccountantFactory - Add configuration options for enabling and setting per-query memory limits - Integrate memory checks into BaseOperator and MultiStageOperator nextBlock() calls - Add ThreadAccountantOps.checkMemoryAndInterruptIfExceeded() utility method - Add comprehensive unit tests covering all scenarios Configuration: - accounting.per.query.memory.check.enabled (default: false) - accounting.per.query.memory.limit.bytes (default: 1GB) Usage: Operators now automatically check memory usage on each nextBlock() call and will terminate queries with detailed error messages if limits are exceeded. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
