Re: Columns/Field index semantic for parquet FileReader

2020-11-16 Thread Radu Teodorescu
ok, I retract my last question on mapping arrow fields to parquet leaf nodes, all the pieces are there and it’s a 5 line function. I still feel a bit thrown off by the column index semantics, but I see how it can open up for more interesting requests where once would want a subset of a struct.

Columns/Field index semantic for parquet FileReader

2020-11-16 Thread Radu Teodorescu
Hi, (my apologies if this has already been discussed) I just took a stab at the struct support in parquet FileReader and I am a bit confused by the column index semantic when trying to read a subset of columns from a subset of row groups: Say I have a single column arrow table top: struct {