I've commented on the PR. I'm +1 on the principle and on the proposed format / layout additions.

Regards

Antoine.


Le 14/12/2022 à 17:27, Matt Topol a écrit :
Hello,

I'd like to propose adding the RLE type based on earlier discussions[1][2]
to the Arrow format:
- Columnar Format description:
https://github.com/apache/arrow/pull/13333/files#diff-8b68cf6859e881f2357f5df64bb073135d7ff6eeb51f116418660b3856564c60
- Flatbuffers changes:
https://github.com/apache/arrow/pull/14176/files#diff-e54b4f5d2d279acc5d1df5df9a7636f0142a8041fe02f07034e0d8be48444b07

There is a proposed implementation available in both C++ (written by Tobias
Zagorni) and Go[3][4]. Both implementations have mostly the same tests
implemented and were tested to be compatible over IPC with an archery test.
In both cases, the implementations are split out among several Draft PRs so
that they can be easily reviewed piecemeal if the vote is approved, with
each Draft PR including the changes of the one before it. The links
provided are the Draft PRs with the entirety of the changes included.

The vote will be open for at least 72 hours.

[ ] +1 add the proposed RLE type to the Apache Arrow format
[ ] -1 do not add the proposed RLE type to the Apache Arrow format
because...

Thanks much, and please let me know if any more information or links are
needed (I've never proposed a vote before on here!)

--Matt

[1] https://lists.apache.org/thread/bfz3m5nyf7flq7n6q9b1bx3jhcn4wq29
[2] https://lists.apache.org/thread/xb7c723csrtwt0md3m4p56bt0193n7jq
[3] https://github.com/apache/arrow/pull/14179
[4] https://github.com/apache/arrow/pull/14223

Reply via email to