2010YOUY01 commented on issue #16244:
URL: https://github.com/apache/datafusion/issues/16244#issuecomment-2938068143

   It's a good idea.
   
   A quick reminder for someone who is willing to implement it: It's possible 
that multiple `Array`s share the same underlying buffer -- those `Array`s can 
be within the same batch or across batches.
   The current memory accounting utilities only support detect buffer reuse 
within the batch (not across batches), so a extension to this might be needed.
   
https://github.com/apache/datafusion/blob/d68111df51980a691dfa8746e34566126858558f/datafusion/physical-plan/src/spill/mod.rs#L239


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

Reply via email to