Micah Kornfield created ARROW-8600: -------------------------------------- Summary: [C++]Expose API for pushing down rep/def level comparison down to decoder Key: ARROW-8600 URL: https://issues.apache.org/jira/browse/ARROW-8600 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Micah Kornfield
[https://github.com/apache/arrow/pull/6985] shows the benefit of using SIMD for level to bitmap conversion. We can do even better by exploiting RLE runs when doing comparisons. Exposing an appropriate API and using that would likely improve real world use-cases even further. -- This message was sent by Atlassian Jira (v8.3.4#803005)