[
https://issues.apache.org/jira/browse/ARROW-384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15688028#comment-15688028
]
Wes McKinney commented on ARROW-384:
------------------------------------
On this layout:
{noformat}
<metadata size: int32> <metadata> <buffers>
{noformat}
One issue we need to address is alignment / padding. The {{<metadata size:
int32> <metadata>}} block should be 64-byte aligned. I don't think that the
flatbuffers library cares about the alignment, but the buffer block should
start on a 64-byte offset. Whatever we decide we will want to write this up in
the format docs
> Align Java and C++ RecordBatch data and metadata layout
> -------------------------------------------------------
>
> Key: ARROW-384
> URL: https://issues.apache.org/jira/browse/ARROW-384
> Project: Apache Arrow
> Issue Type: Bug
> Reporter: Julien Le Dem
>
> layout on C++ side:
> {noformat}
> <buffers> <metadata> <metadata size: int32>
> {noformat}
> and on the java side:
> {noformat}
> <metadata> <buffers>
> {noformat}
> In the file format the footer has a Block info that contains the metadata
> length.
> https://github.com/apache/arrow/blob/f082b17323354dc2af31f39c15c58b995ba08360/format/File.fbs#L36
> See:
> https://github.com/apache/arrow/pull/211#issuecomment-262080545
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
