Hi all, > We hope this will go as far as removing arrow physical types completely > from planning process, i.e. even physical plans will use the logical types. > > BTW I want the logical types to be "the types", and be the only thing > function implementors need to be worried about.
This is pretty ambitious and it would be great to achieve. However, we have to be very careful in doing this (if it is doable, which I’m not entirely sure about). There is a wide variety of calculations done in the physical layer (via PhysicalExprs etc.) that depend on type richness and various supported behaviors (e.g. interval arithmetic calculations). Ensuring that the functionality carries over without downstream complications will not be straightforward. Mehmet Ozan Kabak --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@datafusion.apache.org For additional commands, e-mail: dev-h...@datafusion.apache.org
