Hi, Speaking of the computational kernels I found that Cast needs significant improvement. Right now it can not cast a FixedSizeBinary array to a Binary one which caused my ORC tests to be unusually long. I plan to significantly expand it within 2 months to include nested types and make ORC (and maybe Parquet, Feather, CSV etc) testing much simpler. (In case you wonder why this is needed..since Arrow generally have a lot more formats than other hence to_arrow(from_arrow(table)) and table are usually not equal and casting is necessary.) Is this something we want to work on?
Ying > On Nov 21, 2020, at 6:08 AM, Kirill Lykov <lykov.kir...@gmail.com> wrote: > > Hi, > > There are some computations kernels in arrow and it looks that this part is > in active development right now. I wonder if there is a document / some > emails describing what is the goal and uses cases for this part of the code > base. Would be very interesting to know a bit more and I would like to > contribute at some point. > I'm interested because I develop a Proof-of-concept for a declarative > language to perform statistical computations on top of gandiva. > > -- > Best regards, > Kirill Lykov
