Re: Handling pandas.Timestamps in nanos

2021-12-03 Thread Piotr Findeisen
Hi, I don't know about Pandas, but the question about timestamp precision is interesting to me nonetheless. At Starburst, we've had customer asking for nanosecond timestamp precision, and this drove adding that capability to Trino. (Actually, picosecond timestamp precision was implemented, but I a

Handling pandas.Timestamps in nanos

2021-12-03 Thread Mayur Srivastava
Hi, Is there a best practice for handling the pandas.Timestamps (or numpy.datetime64) in nanos in Iceberg? How are the Python users working with the timestamps in nanos precision, especially if is a part of the PartitionSpec? Thanks, Mayur