Hi Ben,

Le 27/09/2023 à 23:25, Benjamin Kietzman a écrit :

@Antoine
What this PR is creating is an "unofficial" Arrow format, with data
types exposed in Arrow C++ that are not part of the Arrow standard, but
are exposed as if they were.

We already do this in every implementation of the arrow format I'm
aware of: it's more convenient to consider dictionary as a data type
even though the spec says that it is a field property.

I'm not sure I understand your point. Dictionary encoding is part of the Arrow spec, and considering it as a data type is an API choice that does not violate the spec.

Raw pointers in string views is just not an Arrow format.

Regards

Antoine.

Reply via email to