Hi all, Now in Arrow Timestamp type, it support different TimeUnit(seconds, milliseconds, microseconds, nanoseconds) with int64 type for storage. In most cases this is enough, but if the timestamp value range of external system exceeds int64_t::max, then it's impossible to directly convert to Arrow Timestamp, consider the following user case:
A timestamp in other system with int64 + int32(stores milliseconds and nanoseconds) can represent data from 0000-00-00 to 9999-12-31 23:59:59.999999999, if we want to convert type like this, how should we do? One probably create an extension type with struct(int64, int32) for storage. Besides ExtensionType, are we considering extending our Timestamp for wider range or maybe a new type for cases above? Thanks, Ji Liu