Hi all,

Now in Arrow Timestamp type, it support different TimeUnit(seconds,
milliseconds, microseconds, nanoseconds) with int64 type for storage. In
most cases this is enough, but if the timestamp value range of external
system exceeds int64_t::max, then it's impossible to directly convert to
Arrow Timestamp, consider the following user case:

A timestamp in other system with int64 + int32(stores milliseconds and
nanoseconds) can represent data from 0000-00-00 to 9999-12-31
23:59:59.999999999, if we want to convert type like this, how should we do?
One probably create an extension type with struct(int64, int32) for storage.

Besides ExtensionType, are we considering extending our Timestamp for wider
range or maybe a new type for cases above?


Thanks,
Ji Liu

Reply via email to