dwsmith1983 opened a new issue, #5656:
URL: https://github.com/apache/datafusion-comet/issues/5656

   ### What is the problem the feature request solves?
   
   Follow-up from the native Delta Lake scan review (#5365). The native-format 
deletion vector decoder enumerates each deleted position and reinserts it into 
a treemap, paying an extra pass. Preserving the compressed bitmap containers 
during conversion would avoid it. Portable-format decoding already deserializes 
directly.
   
   Evaluation should cover sparse, contiguous, and alternating deletion 
patterns, measuring decoding time and allocations. This does not remove the 
later iteration needed for partial row group selections.
   
   ### Describe the potential solution
   
   A candidate patch preserving sub-bitmap containers via from_bitmaps exists 
and can be adapted once #5365 lands.
   
   ### Additional context
   
   Raised in the #5365 review discussion.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to