Thanks so much Weston. Both [1][2] are informative, and I will check them
out. Thanks.
On Mon, Jan 2, 2023 at 5:05 AM Weston Pace wrote:
> There was a discussion a while back about representing complex numbers
> that seems similar[1]. If both fields were the same type you could
> use a fixed si
Apologies for being very late to this discussion, but if anyone is still
interested in this work, I did quite long ago attempt something like this
at https://github.com/westonsteimel/pyarrow-parquet. Eventually I gave up
on that approach (due to the time taken for builds etc) and instead moved
to
There was a discussion a while back about representing complex numbers
that seems similar[1]. If both fields were the same type you could
use a fixed size list array. However, since you want two different
types you'd want some kind of "packed struct" which does not exist (to
my knowledge) today.
Hi there,
Happy new year.
I store some data in arrow IPC files. And I have two fields that are always
accessed at the same time, namely, when accessing these two fields, they
are accessed in a row oriented manner and are always fetched together, but
other fields are accessed in columnar manner. O
