Hi Micah,
Thanks for your comments.
I am aware that you have invested lots of time and effort in reviewing the
algorithm related code.
We really appreciate it. Thank you so much.
I agree with you that the plan document is a good idea.
In general, the algorithms are driven by applications, so it
Hi Wes,
Thanks a lot for the comments.
You are right. This can be applied to the data encoding/compression, and I
think this is one of the building blocks for encoding/compression.
In the short term, it will provide conversions between the two memory
layouts of run length vectors.
In the mid term
>
> Having utility algorithms to perform data transformations seems fine
> if there is a use for them and maintaining the code in the Arrow
> libraries makes sense.
In principle I agree. The genesis of this discussion was a request I made
to Liya Fan on the PR for this algorithm [1].
Specifical
hi,
Having utility algorithms to perform data transformations seems fine
if there is a use for them and maintaining the code in the Arrow
libraries makes sense.
I don't understand point #2 "We can transform them to delta vectors
before IPC". It sounds like you are proposing a data compression
tec
Dear all,
We want to support a feature for conversions between delta vector and
partial sum vector. Please give your valuable feedback.
Best,
Liya Fan
What is a delta vector/partial sum vector?
Given an integer vector a with length n, its partial sum vector is another
integer vector b with len
