vigneshsiva11 opened a new pull request, #20077:
URL: https://github.com/apache/datafusion/pull/20077
## Which issue does this PR close?
- Closes #20074
## Rationale for this change
ArrowBytesViewMap was previously accounting for the logical number of null
bits when reporting memory usage. This under-reported memory consumption is
because NullBufferBuilder may allocate more memory than is currently used.
Memory accounting in DataFusion is expected to reflect allocated memory
rather than logical usage to ensure accurate memory tracking.
## What changes are included in this PR?
- Update ArrowBytesViewMap::size to use NullBufferBuilder::allocated_size
instead of calculating size from the number of used null bits.
## Are these changes tested?
- Yes. Existing tests were run:
- cargo test -p datafusion-physical-expr-common
## Are there any user-facing changes?
- No. This change only affects internal memory accounting and does not alter
query behavior or public APIs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
