Jason Fehr has uploaded this change for review. ( http://gerrit.cloudera.org:8080/24159
Change subject: [WIP] IMPALA-14863: Fixes Potential OOM During Row Batch Processing ...................................................................... [WIP] IMPALA-14863: Fixes Potential OOM During Row Batch Processing Impala checks at the end of every row batch to determine if the query or process memory limit has been exceeded. In certain cases, row batch processing can consume memory until the process memory limit is reached. At that point, the executor begins failing other queries with cannotallocated memory errors as they request memory. However, the row batch processing continues to run since it does no memory limit checking. This patch determines the proper soft memory limit based on the lesser of the query and process soft limit. When expression evaluation results memory pool exceeds that threshold, the memory pool is freed during which row batch processing is paused. Generated-by: Github Copilot (GPT-5.3-Codex) Change-Id: Ic54b5c39e1388681275681f22e61b27728dba5af --- M .gitignore M be/src/codegen/gen_ir_descriptions.py M be/src/exec/partitioned-hash-join-node-ir.cc M be/src/exec/partitioned-hash-join-node.cc M be/src/exec/partitioned-hash-join-node.h M be/src/exprs/scalar-expr-evaluator.cc M be/src/exprs/scalar-expr-evaluator.h 7 files changed, 82 insertions(+), 46 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/59/24159/1 -- To view, visit http://gerrit.cloudera.org:8080/24159 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Ic54b5c39e1388681275681f22e61b27728dba5af Gerrit-Change-Number: 24159 Gerrit-PatchSet: 1 Gerrit-Owner: Jason Fehr <[email protected]>
