[
https://issues.apache.org/jira/browse/ARROW-14330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neal Richardson reassigned ARROW-14330:
---------------------------------------
Assignee: (was: Alexander Ocsa)
> [C++] Create DataHolder that can be used for caching during exec plans
> ----------------------------------------------------------------------
>
> Key: ARROW-14330
> URL: https://issues.apache.org/jira/browse/ARROW-14330
> Project: Apache Arrow
> Issue Type: Sub-task
> Components: C++
> Reporter: Alexander Ocsa
> Priority: Major
> Labels: pull-request-available, query-engine
> Fix For: 9.0.0
>
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> The purpose of this task is to make an ExecNode that can provide the
> following functionality.
> # Be able to obtain heuristics about our memory consumption and have a
> memory consumption threshold
> # Be able to write incoming ExecBatch to disk if memory consumption is above
> the threshold, stores either the ExecBatch or a handle to file in a queue.
> # Provide an api for pulling an ExecBatch from the queue. It should favor
> pulling all of the batches that are in memory first and then the ones that
> are handles to files.
>
> PRs to reference
> [https://github.com/apache/arrow/pull/11017/]
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
