Wes McKinney created ARROW-398: ---------------------------------- Summary: [Java] Java file format requires bitmaps of all 1's to be written when there are no nulls Key: ARROW-398 URL: https://issues.apache.org/jira/browse/ARROW-398 Project: Apache Arrow Issue Type: Bug Components: Java - Vectors Reporter: Wes McKinney Priority: Blocker
>From the format specification "Arrays having a 0 null count may choose to not >allocate the null bitmap. Implementations may choose to always allocate one >anyway as a matter of convenience, but this should be noted when memory is >being shared." When the null count is 0 and the validity buffer has length 0, then in Java for now the simplest thing will be to allocate a new validity buffer with all 1's. See the corresponding C++ logic where a 0-length buffer is being written when the null count is 0: https://github.com/apache/arrow/blob/master/cpp/src/arrow/ipc/adapter.cc#L83 -- This message was sent by Atlassian JIRA (v6.3.4#6332)