I don't think the exact behavior you want is supported, see [1], so I
think your assessment of the code is correct.
To store field-level metadata, I think you'd have to approach this
with the higher-level Arrow APIs and ship the field-level metadata
inside the Arrow Schema, see [2].
[1] https://g
Thanks for your response
On Mon, Jan 6, 2025 at 4:39 PM Bryce Mecum wrote:
>
> Are you able to share your code, particularly how you build your
> ArrowWriterProperties?
>
> The Arrow Schema and therefore the field-level metadata is actually
> stored in the Parquet file as an opaque blob. Opaque i
Unsubscribe
I think [1] is what you're looking for.
[1]: https://arrow.apache.org/docs/format/Columnar.html#ipc-file-format
# --
# Aldrin
https://github.com/drin/
https://gitlab.com/octalene
https://keybase.io/octalene
On Wednesday, January 8th, 2025 at 12:29, Andrew Be
Hi,
Is there a specification for the Feather file format? All I can find
is https://arrow.apache.org/docs/python/feather.html, which is
insufficient to exactly describe the format.
Thanks,
--
Andrew Bell
andrew.bell...@gmail.com
The link Aldrin sent is correct. To help connect the dots I'll point out
this quote:
> Note that files created with this format are sometimes called “Feather
V2” or
> with the “.feather” extension, the name and the extension derived from
> “Feather (V1)”, which was a proof of concept early in the
